I tried to register a flow to Prefect cloud and store it on S3. AWS_CREDENTIALS is set as secret within Prefect Cloud. If I register the flow i receive the following error:
botocore.exceptions.NoCredentialsError: Unable to locate credentials
The backend is set to cloud and I logged in successfully (
prefect auth login ...
)
How could I use the AWS_CREDENTIALS secret which is set in the cloud?
c
CA Lee
03/16/2021, 11:01 AM
Hello @Timo, Prefect cloud secrets are called when the flow is run by your chosen execution environment remotely.
For the flow to register successfully, you need to provide creds to botocore locally (see this).
There are a couple of ways to do this, but the simplest would be to run
aws configure
and enter your access id and key accordingly.
Alternatively, you can also create a file called
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.