Is it possible to make Ubuntu ask for my password before mounting USB drives?

You could try encrypting your usb drive on filesystem level. Take a look at Ubuntu Community Help Wiki EncryptedFilesystemHowto. It explains in a quite detailed way the steps you have to take plus it has some examples.