How to subtract the column means from each row of a matrix?

It is there:

Standardize[mat, Mean, 1 &]

Well, transposing, subtracting, transposing...

Transpose[Transpose[mat] - Mean[mat]]

mat - ConstantArray[Mean[mat], 3]

or more generally:

mat - ConstantArray[Mean[mat], Length[mat]]