Where do I go to see what the hell my ECS tasks are actually doing when they enter "pending" state?

It won't tell you until it stops.

Click "Stopped" next to "Running" and you should find all the previously pending tasks that already failed. It should show a reason for these failures.