https://prefect.io logo
Title
b

Ben Strange

08/19/2022, 11:08 AM
Hello everyone, Has anyone attempted accessing a public s3 bucket using the S3 block or know of a work around? Had a good search around but can't seem to find how you could change the S3 validation.
1
a

Anna Geller

08/19/2022, 11:27 AM
The credentials on the block are optional so this should work. You may also check the blocks from the prefect-aws collection - there are blocks there like S3Bucket https://github.com/PrefectHQ/prefect-aws/blob/main/prefect_aws/s3.py#L232 or you can do:
import fsspec

fs = fsspec.filesystem("s3")
fs.put("/Users/anna/repos/dataflow-ops/docs", "<s3://prefect-orion/docs>", recursive=True)