Visual Studio in the cloud?

Windows Azure Virtual Machines come to mind here. Now, granted, you will have to install and have licenses for all the software you wish to use (Though I think a MSDN license would cover you). But, you could easily deploy a VM, configure with all of your development tools then save that as a template. The template could then be redeployed in minutes to any number of VMs.

Azure virtual machines can do VPN and join domains.

Building on the answer Paul gives above, there is a Virtual Machine image in Windows Azure (for MSDN subscribers). IT's a pretty new approach for us however I believe fulfills your requirements including WW public access and a VPN solution.

You can read about the details here: http://visualstudio2013galleryimage.azurewebsites.net/

You can see a short video of the feature in action here: http://channel9.msdn.com/Events/Visual-Studio/Launch-2013/WC120

Let me know if you have questions or feedback about this approach.

Thanks,

Paul Yuknewicz, Lead PM, Visual Studio