Hilbert space basis which is not a vector space basis

Yes, it is entirely correct. Actually, it can be proved that a Hilbert space is infinite-dimensional if and only if no Hilbert basis is a basis in the Linear Algebra sense.

Yes, that's true. Any actual vector space basis for $\ell^2$ has to have the same size as $\mathbb{R}$ and cannot be explicitly written down.