Cancel notification after application is closed from background

You have your notification an ID when your created it, right?

Then all you have to do is use that ID to cancel it.
For example:

NotificationManager mNotificationManager = (NotificationManager) getSystemService(Context.NOTIFICATION_SERVICE);
mNotificationManager.cancel(4);

on destroy is fired when they back out of your app or if you call finish() on your activity.