Hi all 👋! Is there some way to interact with the data produced by
persist_result=True
programmatically in Prefect 2? e.g. initialize a local flow run with persisted state/results from some remote flow run?
Usecase: Flow fails in remote environment a few hours into a run. It'd be nice if a developer could run that flow locally in their debugger, but initialize the flow using the persisted results from the remote run to skip straight to the tasks that failed.
z
Zanie
01/26/2023, 10:24 PM
You could run the flow locally with
python -m prefect.engine <flow-run-id>
and it would load the existing task states and results instead of starting them again
Zanie
01/26/2023, 10:25 PM
A more proper way to go about it would be to configure task run cache keys though.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.