Unable to get provider com.google.firebase.perf.provider.FirebasePerfProvider on pre-lollipop devices

Fixed it!

Although I had multidex imported and enabled in Gradle, I had to change my Application class to extend MultidexApplication instead of Application.

Hope it helps others too!