Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Can I make tasks read from a local folder as a cache using `snapshotting`?

You can use <https://docs.prefect.io/core/idioms/targets.html|targets> where you specify a filename and if that file exists, the task the will not re-run and load instead. Similarly, you can use <https://docs.prefect.io/core/concepts/persistence.html#output-caching|caching> and if the task is cached, it will not run and just read the data in.

No they are always rerun even if I do this

image.png

This looks right. Could you run with DEBUG level logs so we can see the logs around caching?

Can you check to see if the files are persisted?