Hi, I am trying to do task level parallelism by mapping. I was wondering how to set it up so each task is independent say that one of task’s failure would not affect other tasks being paralleled. Thanks in advance!

Hi Estelle, are you talking about tasks downstream of your mapped task? If so, you can change the trigger rule so that they will run regardless of whether the mapped tasks upstream fail https://docs.prefect.io/api/latest/triggers.html#functions

Not exactly. I am referring to all tasks at the same level (let’s say that there is no downstreem tasks for now).

What executor are you using? Local or Dask?

Dask cluster

It should be independently executed and continue even if one of them fails. Are you seeing your entire flow just stop?

I see, the flow run indicated as failure even if only one task failed. Thanks

i think this is the intended behavior. if you want to change it after the task runs complete you may be able to make a task that changes the state of the previous task or something like that. I'm not sure why you would want the parent to show up as succeeded if one if its mapped tasks failed though