Jenkins throws "Client does not have permissions to send as this sender"

The email should be changed in three places as below as per version 2.19.4:

Extended E-mail Notification - If using SMTP plugin

Email Notification - SMTP Authentication

Jenkins location - System Admin e-mail address

Finally got it, thanks to Friso

Had to set my email address in System Admin e-mail address under Jenkins Location.