Remove releases in GitLab

By now you can delete releases properly using the API:

https://docs.gitlab.com/ee/api/releases/#delete-a-release

1. Go to Project Overview -> Releases
2. Click the release you want to delete
3. Scroll to the bottom. Find the tag icon. Click on the tag.
4. There is a trash can button for the tag. Deleting the tag will delete the release as well.