Can't delete Connected App

You should be able to delete the Connected App by going into the app itself:

Setup -> Create -> Apps -> Click on the Connected App -> Delete