RDP, how to hide local Taskbar when an always-on-top window exists
How-to-fix-it: Bring up the task manager on the local computer, right-click "Windows Explorer" and select "Restart".
I re-opened the RDP session and now the Fullscreen worked fine again.