How often do initializers run in Rails?

A very simple and straight answer is: Just once, when your server kicks up.

You may be intrested in this article The Rails Initialization Process

Initializers get loaded whenever you start up passenger / mongrel or whatever you are using.

To set these settings at runtime take a look at Rails: Runtime configuration of ActionMailer?