Can we have a Post Install Script for unmanaged package

No, this is only available for managed packages.

I don't have a doc handy that says this explicitly, but you'll notice all references to them are in the context of managed packages (like this one)

I've also personally heard the packaging PM specifically confirm this.