How to cleanly remove Exim4 mail server on Ubuntu

Here's all you need to do to cleanly and easily get rid of Exim4:

apt-get remove exim4 exim4-base exim4-config exim4-daemon-light

You may have the exim4 logs directory left behind. Just get rid of it manually, if you do:

rm -r /var/log/exim4/

What I would do:

apt-get remove exim4*