Django Admin's "view on site" points to example.com instead of my domain

You have to change default site domain value.

The funniest thing is that "example.com" appears in an obvious place. Yet, I was looking for in in an hour or so.

Just use your admin interface -> Sites -> ... there it is :)