Is there a special name for a field where each number has a square root?

Yes, those fields are called quadratically closed fields.

If you are interested in ordered fields in which every positive element has a square root, then you are looking for Euclidean fields.