Lightning Component quick action not appearing in available actions for Lightning App page

This isn't supported in App Builder yet. It's definitely on our radar and is something we'd like to fix in a near term release (safe harbor).