NIS failing to bind
Ha - I've been trying to figure this out for hours, but just realized the NetworkManager daemon is running, which apparently is blocking when the network interfaces are set to not use the NetworkManager.
Simply running
service NetworkManager stop
And then restarting fixed everything. Hopefully this will help other people out - I saw a bunch of similar looking symptoms online but no-one mentioned the NetworkManager at all.