Open Source C++ game engine math libraries?

I'd recommend OpenGL Mathematics (GLM)

Though if you want physics with your math you could go with Bullet Physics Library

Finally if you want an entire engine i'd go with OGRE

You might want to consider Blitz++.

Besides Ogre 3D, there's also Crystal Space. Here's an article that compares the two.