Daniel Lomartra
10/11/2023, 9:25 PMwait_for
parameter to my third mapped task. What am I missing here?
from prefect import flow, task
@task
def task0(input):
pass
@task
def task1(input, task0_input):
pass
@task
def task2(input, task0_input):
pass
@task
def task3(input, task0_input):
pass
@flow
def map_flow(input):
task0_complete = task0.map(input)
task1_complete = task1.map(input,task0_complete)
task2_complete = task2.map(input,task0_complete)
task3_complete = task3.map(input,task0_complete,wait_for=[task1_complete,task2_complete])
map_flow([0,1])
Nate
10/12/2023, 2:36 PMtask0_complete
to everything, you're telling prefect that there's a data dependency there, so each task0 instance will point into every downstream task instance
if you add some sleeps, its a bit easier to see
what is your actual use case?Daniel Lomartra
10/12/2023, 2:39 PM