In which cases is the inverse of a matrix equal to its transpose?

If $A^{-1}=A^T$, then $A^TA=I$. This means that each column has unit length and is perpendicular to every other column. That means it is an orthonormal matrix.

You're right. This is the definition of orthogonal matrix.