Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hey, community!

How do I set up task caching for k8s jobs? not really clear what setting `PREFECT_LOCAL_STORAGE_PATH`  does in this context, I guess points to pod’s filesystem and persistent storage/bucket has to be mounted to a path

We are working on supporting remote storage for results. For now, this stores results in the execution layer which in your case means within the KubernetesJob's pod.