How do I remove a VirtualBox host only network adapter

Looks like the VBoxManage command line tool is how to do it. Couldn't find a way to do it from the GUI, but this seems to work:

VBoxManage hostonlyif remove vboxnet4

(replace the '4' accordingly, of course)

Open Virtualbox, click File -> Preferences -> Network -> Host-only Network, remove Vboxnet#