ORA-00988: missing or invalid password(s)

Turns out one doesn't put the password in single quotes. Double quotes are required if the password contains some special characters.

alter user FOO identified by 'BAR'; -- Broken
alter user FOO identified by BAR;   -- Works
alter user FOO identified by "BAR"; -- Works

alter user davidl identified by "newpassword" replace "oldpassword";