suggestions for a 3D graph rendering library?

I would recommend using Java3D for the visualization part

• Java 3D Tutorial Introduces the concepts

• Download Site contains the libraries and a few demo projects, for a quick start.

To do the layout of your graph you could look for an algorithms in JUNG and check whether the can be easily extended to 3D.

JUNG layout demo

• A link collection on graph layouts