Why is scp with compression slower than without?

Quoting man ssh (which is the base used by scp):

Compression is desirable on modem lines and other slow connections, but will only slow down things on fast networks.

The problem is that compressing the data takes more time then just sending it over the network.