I have a question about using GCS as flow storage with an ECS Agent. When I create a flow, I assume...
b
I have a question about using GCS as flow storage with an ECS Agent. When I create a flow, I assume I should put
GOOGLE_APPLICATION_CREDENTIALS
in the environment variables of my ECSRun configuration. But, with that said, should I create an image with a volume that contains my json key file? And then I would use the path of this volume as
GOOGLE_APPLICATION_CREDENTIALS
, right? I wonder what's the best practice in this case. Thanks in advance!
k
Hey @Barbara Abi Khoriati, if you use GCS, and Google Cloud tasks of Prefect, they use this utility function to get credentials. And in general, the default secret name Prefect uses is
GCP_CREDENTIALS
instead of the
GOOGLE_APPLICATION_CREDENTIALS
. I think that it will fallover to
GOOGLE_APPLICATION_CREDENTIALS
though. I think you can do it that way yes. Some users just store the
GCP_CREDENTIALS
Secret entirely on Prefect Cloud and then pull it for their flows
b
Thanks! @Kevin Kho