https://prefect.io logo
Title
l

Luca Schneider

09/13/2021, 5:26 PM
Hi there, I set a prefect server on k8s and Minio as S3Storage. I created the docker image with the python dependencies. However, I’m having issue setting up the correct “AWS_CA_BUNDLE” as I’m using my companies certificates. I can see from prefect logs that it failed due to SSL verification. I sat up the correct env variable in the docker image, i.e. providing the CA file and setting up the “AWS_CA_BUNDLE” (see here: https://boto3.amazonaws.com/v1/documentation/api/latest/guide/configuration.html#using-environment-variables). Any clue ?
k

Kevin Kho

09/13/2021, 5:34 PM
Hey @Luca Schneider, these things are quite hard to get working, but everything you did seems right in using the env variable in the Docker image and providing the CA file. Does it work outside the image?
l

Luca Schneider

09/13/2021, 5:36 PM
well the script on my laptop seemed to have uploaded correctly the flow to MinIO. Thus, I’d say yes
k

Kevin Kho

09/13/2021, 5:38 PM
I’m probably not helping here, but are the versions the same of boto3 and python requests?
l

Luca Schneider

09/13/2021, 5:41 PM
I’ll check tomorrow since i left work. I was wondering if there was anything to provide to the kubernetes agent
I forgot to mention that I’m using KubernetesRun and for the moment I only provided the AWS_CA_BUNDLE to the python image being pulled by k8s
k

Kevin Kho

09/13/2021, 5:45 PM
If the certificate is in the image, you can use the RunConfig to make sure the environment variable is set to point to it. Env variable should work though in the image I think. You can also pass the env variable through the agent with the
--env
flag.
l

Luca Schneider

09/13/2021, 6:00 PM
ok thanks. I’ll try and keep you updated
found the issue. it was the boto client config being passed
👍 1