finish() finish the activity but it is still on background

try using

android:excludeFromRecents="true" in your Activity in AndroidManifest.xml.

<activity
            ...
             android:excludeFromRecents="true">
</activity>