How do I get rid of monitor audio devices from Windows 10
...And just like that, I had another idea and found the answer.
Open the Sound Settings, click "Sound Control Panel" and disable the devices you want to get rid of from there.
As of the latest Windows 10 updates, this is now possible with mostly native Windows 10 controls.
Settings, System, Sound, Manage Sound Devices
Locate the devices that you don't want to provide sound, select them, and press the Disable button on each one.