Barada Sahu
09/06/2022, 5:16 PMwait_for
), it’s never triggered, rather goes into an undocumented NotReady
state.
To overcome this, I have to set .result(raise_on_failure=False)
on the upstream task. See images below for states. See screengrabs 👇 - left fails, right works.
This seems like a common DAG use-case which should be handled well by prefect, how do we wait on a set of upstream tasks to complete and then perform a cleanup / notification at the end (with an aggregate of results from all upstream tasks).Zanie
09/06/2022, 5:17 PMwait_for
indicates that the upstream needs to complete successfully for the downstream to run.Barada Sahu
09/06/2022, 5:19 PMOliver Mannion
09/22/2022, 9:10 AM@task(trigger=any_successful)
in Prefect 1, and are looking for something similar in Prefect 2