Failed to debug the Windows Azure Cloud Service Project. The output directory does not exist. / Azure SDK 2.3 / VS 2013

For me, the issue was I changed the Debug Solution Configuration to something other than Debug. Renaming it back to Debug fixed the issue.

I was able to solve this issue by simply uninstalling Azure SDK 2.3 and then re-installing it. That's it!