Apple - Screen video capture application
I've found that "New Screen Recording" functionality in QuickTime Player combined with iMovie editing capabilities is enough for my needs. Maybe you can give it a try? Best of all, it's already installed on your Mac. Unfortunately, I can't compare it with Camtasia, as I haven't used it.
After some research I've learnt that for the second use case you can use a separate program that does mouse magnification and keystroke detection in conjunction with a regular screen recording program like Quicktime Player (included on Mac OS X). Mouseposé seems the most recommended one.
As for a standalone screen capture program that has more features than Quicktime Player, I've found four that are maybe the most widely used ones:
- ScreenFlow
- Camtasia for Mac
- iShowU
- Snapz Pro X
ScreenFlow offers mouse cursor customization, and iShowU offers keystroke and mouse action recording, for showing in the video. ScreenFlow, iShowYou and Camtasia are looking great. Snapz Pro X seems more focused to regular screenshot capturing, but does video as well.
There's a question about recording the screen of an OpenGL application without stuttering here at StackExchange.