Does a gauge transformation leave physics invariant?

The statement

because the gauge transformation is not supposed to change anything, it means that every expectation can be calculated equivalently using $ \psi' $ or $ \psi $

isn't particularly correct. All physically measurable expectation values can be calculated correctly in any arbitrary gauge, but the operator representation of some operators can change from one gauge to another.

The particular sticking point here is the difference between kinetic momentum and canonical momentum. To be clear,

• kinetic momentum is always equal to $m\mathbf v$, it is physically measurable, and it must therefore be gauge invariant, whereas
• canonical momentum is the quantity $\mathbf p$ such that $[\hat x_i,\hat p_j] = i\hbar \delta_{ij}$ (so therefore its position representation is always the gradient, i.e. $\langle \mathbf x|\hat p_j = -i\hbar \frac{\partial}{\partial x_j}\langle \mathbf x|$), and it is not gauge invariant. As an example, in the presence of an electromagnetic field, the canonical momentum typically differs from the kinetic momentum by a multiple of the vector potential $\mathbf A$.

When you change gauges, it's important to take care to transform all the relevant observables in the process; failure to do this is probably the most common reason for confusion regarding spurious gauge dependences in results.

It's also important to note that none of this is specific to quantum mechanics, and you get exactly the same issues and concepts from the beginnings of lagrangian mechanics, from gauges and gauge changes to the mismatch between canonical and kinetic momentum. For details, see your favourite analytical mechanics textbook.

You are right. The momentum operatur is not gauge invariant. If you demand that measurable quantities are gauge invariant (it is a sensible requirement), the momentum.is not a measurable quantity. Velocity is though. The only book I could find mentioning this is Ballentines. Ballentine 'Quantum Mechanics' states in Chapter 11: "Since p, like A, is changed by a gauge transformation, it too lacks a direct physical significance." (then some calculations on the velocity operator follow)