Hi all!
Is there any way not to fail the entire flow that consists only of 1
map
task and some
mapped
runs are failed?
Thx in advance)
k
Kevin Kho
10/08/2021, 1:44 PM
Hey @Max Kureykin, what would your criteria for Flow success/failure be?
m
Max Kureykin
10/08/2021, 1:47 PM
I have some strange problem with task, which is not related to prefect. It happens 1-2 times over 5000 mapped runs.
For me it is ok, but the flow would be marked as failed
k
Kevin Kho
10/08/2021, 1:49 PM
If you just want it to always be successful, I would just add a task after the mapped task and have it do nothing.
Copy code
@task
def myreduce():
pass
with Flow() as flow:
map_task = A.mapped([1,2,3])
reduce_task = myreduce(map_task)
And this reduce task should be successful
m
Max Kureykin
10/08/2021, 1:50 PM
funny, got you) thanks😀
k
Kevin Kho
10/08/2021, 1:52 PM
or you can use a Flow State Handler, and just return success
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.