philip
06/05/2020, 1:58 AMnicholas
06/05/2020, 1:59 AMphilip
06/05/2020, 2:00 AMtask = ShellTask()
with Flow("to_bigquery") as flow:
command = task(command='gsutil cp .... .....)
flow.run()
it can success. But when i run on Prefect Server it have an error 401 Anonymous caller does not have storage.objects.list access to the Google Cloud Storage bucket.
nicholas
06/05/2020, 2:04 AMGCP
, which is why flow.run
would succeed - it's running that in an authorized context.
Where is your agent running? Your flow's runtime context doesn't seem to be authorized.philip
06/05/2020, 2:09 AMnicholas
06/05/2020, 2:10 AMphilip
06/05/2020, 2:13 AMnicholas
06/05/2020, 2:15 AMphilip
06/05/2020, 2:25 AMnicholas
06/05/2020, 2:45 AMphilip
06/05/2020, 2:51 AMnicholas
06/05/2020, 3:07 AMShellTask
or use a GCP
service account credentials insteadphilip
06/05/2020, 3:09 AM