https://prefect.io logo
Title
a

Austin Weisgrau

02/09/2023, 6:18 PM
Hi there! I'm used to airflow and getting started in Prefect. I'm used to being able to replay individual tasks from the Airflow UI within a DAG/flow run. It looks like there's no way to do that in Prefect, is that correct? If we want to replay anything, we have to replay the entire flow with a new run.
1
r

redsquare

02/09/2023, 6:48 PM
you could emulate this in a way with task caching or perhaps sub flows but yes having to kick off another flow run
p

Peyton Runyan

02/09/2023, 7:33 PM
Out of curiosity, what's your use case for re-running a single task?
a

Austin Weisgrau

02/09/2023, 7:36 PM
Let's say I have a long idempotent pipeline with 20 tasks. It takes an hour to run. It fails on the final quick task due to an intermittent third party API failure which outlasts my retry settings. To resolve this problem, I just need to retry the final task, which uses data gathered from all the prior tasks as inputs. If I could retry just this task, it would be resolved in 20 seconds. However, it sounds like I'd need to rerun the entire pipeline from the top.
p

Peyton Runyan

02/09/2023, 7:40 PM
a

Austin Weisgrau

02/09/2023, 7:43 PM
I'll check it out, thanks
👍 1