Rails/Nginx/Capistrano/Puma: (111: Connection refused) while connecting to upstream

So the solution was to restart puma.

cap production deploy:restart

Every time I reboot the server, I need to restart puma as well.