I’m having some trouble understanding whether I should be able to run
python myflow.py
and read Secrets within my flow. I’ve added the Secrets in the Cloud UI and authenticated with the prefect CLI. Is the right model that “running a flow locally without an agent never hits the server” or am I mistaken?
Thanks. I was able to set secrets locally using env vars and my flow succeeds. Then if I run a local agent and run a flow from the cloud UI, it succeeds. Now I’m trying to use a docker agent (
prefect agent docker start
) and a
GitLab
storage configuration, and my flows fail:
KeyError('The secret ... was not found...
. I’ve set the secrets in the cloud UI under team settings. Should I be expecting the cloud secrets to be fetched in this scenario?
Jason Prado
05/02/2021, 8:41 PM
Oh haha I see what I did wrong. The credential passed to the GitLab storage object should be the name of a secret, not a literal secret! Should be good now.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.