Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hello! If I have a flow that is successfully check-pointing results (with S3Result in my case), what's the best way to have the flow use the checkpoint in successive invocations as a cache?

Hey <@UTQJ5786P>, it sounds like you can use <https://docs.prefect.io/core/idioms/targets.html#using-result-targets-for-efficient-caching|targets> which is a file based caching. The result will be retrieved if the file exists and the task won’t be re-run. You can then use a filename that has a date or time in it to give a “lifespan” for that target. For example, using YYYY-MM-DD in the filename will make that task not re-run for a day.

Thanks <@U01QEJ9PP53>! do you know if the data from the target will be passed to downstream tasks?

I think it will if returned by the cached task and then used by the downstream task like:
```a = cached_task()
b = downstream_task(a)```

Actually, how big is the data that you are storing? If it’s small and not sensitive, the KV Store is also an option. Edit: you probably want the target though.