Hi,
Is there a way to re-run a Prefect flow, but only from some point on?
E.g. I have 10 tasks in my flow and I'd like to use the cache for the first 4 tasks, but I want everything else to be computed again.
In Prefect 1, I'd normally delete the cache files and run the flow again - when cache file was present, cache would be used. And when cache file would not exist, Prefect would run these tasks.
d
Dominic Tarro
06/15/2023, 1:18 PM
I think the
persist_result
argument for tasks is all you need. If a result is persisted then prefect will automatically use that. If it isn't, it will be rerun.
d
Deceivious
06/15/2023, 7:39 PM
There is no way of doing that as of now. Maybe if Prefect introduces Cache management that will be possible.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.