I'm trying to deploy and run a job in docker and getting error about boto library that I included in...

Jafar A

03/01/2023, 8:01 PM

I'm trying to deploy and run a job in docker and getting error about boto library that I included in docker block but no use in the code yet. what's happening?

Copy code

prefect deployment build src/main.py:ingest_everflow -n test-run-container  -q test
-sb s3/s3-everflow/ef_test_code -ib docker-container/de-container -o prefect-docker-deployment --apply

return self.sign(operation_name, request)

File "/usr/local/lib/python3.10/site-packages/botocore/signers.py", line 189, in sign

auth.add_auth(request)

File "/usr/local/lib/python3.10/site-packages/botocore/auth.py", line 418, in add_auth

raise NoCredentialsError()

botocore.exceptions.NoCredentialsError: Unable to locate credentials

✅ 1

Austin Weisgrau

03/01/2023, 8:27 PM

I believe to use an S3 block your shell needs to be authenticated with AWS / have credentials available in the environment or in ~/.aws/credentials

Austin Weisgrau

03/01/2023, 8:31 PM

Prefect will try and upload your deployment to that S3 block, and it will use boto3 to do that, and the error you are getting is boto3 unable to find AWS credentials with which to access S3

🙌 1

👍 1

Jafar A

03/01/2023, 10:08 PM

@Austin Weisgrau thanks, for some reason the access tokens were gone in sb and now good.

2 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.