ssh still accepts password authentication despite being configured for public-key only authentication (which works!)

/etc/ssh/ssh_config is for the client. You want to set those options on the server config file, which is /etc/ssh/sshd_config.