Hi 👋
I’m currently experimenting with the recent Youtube Demo of some data science prefect flows…
We have an on-premise S3 server that has a custom endpoint_url. Can I use S3Result() to store my plots? How would I provide the endpoint_url and other custom settings?
k
Kevin Kho
05/11/2021, 4:05 PM
Hi @Christian! Do you still use boto3 to connect to a local S3 server?
c
Christian
05/11/2021, 4:09 PM
Basically, I can use regular AWS tools. I just need to set “endpoint_url”. I also use ~/.aws/credentials for instance to define some profiles.
My plan was to use prefect cloud secrets to store my access key, token with the S3Result class to upload plots generated by my tasks to an S3 bucket.
k
Kevin Kho
05/11/2021, 4:12 PM
I ask because I’m wondering if you can supply it as a boto3
kwarg
here . From the aws docs , you can pass in the endpoint URL to the client. This might be doable with something like