How to disable alert sounds on Ubuntu 20.04

Ah, I found it!

Go to system, sound and edit the bar for "system sounds" under the header "Volume Levels".

For me, it was first set to 0, but somehow didn't register. After setting it to loud and then muting it again it worked as required.