How does X11 forwarding work?

Assuming you're using OpenGL, the GPU should be installed on the host where the X server is running. The client will send rendering commands to the X server, which will then take advantage of the GPU to process the rendering commands.