Missing object or bucket in path when running on Dataflow
The DataflowRunner requires that the staging location and temp locations be a location within a bucket rather than the top-level of a bucket. Adding a directory (such as --stagingLocation=gs://df-staging-bucket-57763/staging
or --tempLocation=gs://df-staging-bucket-57763/temp
) to your arguments (for each of the stagingLocation
and gcpTempLocation
arguments) will be sufficient to run the pipeline.