Is it possible to copy a directory from a Google Compute Engine instance to my local machine?

Found it!

GCE offers an equivalent and it is --recurse.

My final command looks like this:

gcloud compute scp --recurse username@instance_name:./* "local_dir"

For some reason I also needed the * behind the source folder to avoid some security issue.