Stop Xbox One controller from controlling Windows 10
Turns out it was the new Steam "Xbox Configuration Support" feature. I disabled it and now the controller doesn't do anything in Windows and all my games work again.
Before (with Issue):
After (Without Issue):