Stop Outlook's "Reminder" from popping up

In Outlook 2015 this option is in a slightly different place, but is easily accessible via File → Options → Advanced Options → Reminders Heading.

In Outlook 2007, that would be:

• Tools
• Options...
• "Other" tab
• Advanced Options
• Reminder Options...
• Uncheck "Display the reminder"