How to avoid a NoClassDefFoundError: android/os/PersistableBundle on pre-L?

Well, the issue is resolved now. After going through all of my code (which I should have done ages ago) I found out that I actually had references to the PersistableBundle. Those were located in methods I let the IDE generate like onPostCreate(PersistableBundle bundle) and wasn't paying attention to. Replacing all PersistableBundle with Bundle fixed the problem.

To folks having similar issue I can only suggest looking closely at the generated stuff when using newer API.