Wordpress - Deleting default category in wordpress

Impossible. WordPress requires a default category, that’s hard coded.

If you need a taxonomy without default value – create a custom taxonomy.