After migrating to prefect 3 my flow started reporting success when underlying tasks have failed. My flow contains nested tasks 1 level deep where the parent tasks are generated with a loop using
.submit()
and thus need to run async. The child tasks can run sequentially if needed but currently also use
.submit()
which saves a small amount of time.
I cannot use
raise_on_failure=true
because it is only accepted as a parameter in
.result()
or
.wait()
which are blocking and force my code to run sequentially and I cannot use
return_state=true
because then my tasks will return
State
objects instead of `Future`objects which again forces the code to run sequentially.
Are there any other options?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.