Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

When using s3 storage does a k8s job when running the flow just download the files from the s3 path indicated in the deployment rather than the whole bucket?

wondering if I can get parent folders included and add to sys path so I can use the functions

The bucket path argument specifies the path

So not the whole bucket, only the given path gets downloaded