Casey Green08/24/2021, 3:35 PM
Kevin Kho08/24/2021, 3:52 PM
task, and then LOOP there. You can just do
inside the big task, but they will just be like functions instead of Prefect tasks.
Casey Green08/24/2021, 3:54 PM
Kinda looks and feels like a code smell 🤷♂️
with Flow("test") as flow: flow_name = Parameter("flow_name", required=True) handle = trigger_job(job_name) result = wait_to_complete(handle) max_runs = 3 # maybe this isn't a case... perhaps a terminal_state_handler that inspects the result and sets the state appropriately? with case(should_re_run(result), True): # trigger flow failure, but automatically retry.
Kevin Kho08/24/2021, 4:39 PM
task, then we have retries, but the concept of a flow retry is not definitive because some users expect everything to run (even successful tasks) and some expect to run from where it left off. I think retries on these two Prefect tasks can be used for both scenarios by supplying a
Casey Green08/24/2021, 5:00 PM