"Could not connect to display" in one user account

I run unit tests of my GUI application using QTestLib on a headless continuous integration server by setting up an X virtual framebuffer.

Xvfb :1 &
PID=$!
DISPLAY=:1 make check
kill $PID