Zac Chien
08/25/2021, 9:49 AMwith Flow('feature-factory') as flow:
a, b = pre_task()
task1.map(a)
task2.map(b)
Zac Chien
08/25/2021, 9:54 AMwith Flow('feature-factory') as flow:
a, b = pre_task()
state = task1.map(a)
task2.map(b, state)
Robert Hales
08/25/2021, 11:00 AMupstream_tasks
kwarg is what you’re looking forZac Chien
08/25/2021, 11:16 AMb.map(task2, upstream_tasks=[task1.map(a)])
I don’t know why task2 only run once (should be 9 runs), in my case, feature_generator=task1, dataset_generator=task2Zac Chien
08/25/2021, 11:18 AMa_task = task1.map(a) a_task.set_downstream(task2.map(b))
Kevin Kho
a = A.map(...)
b = B.map(..., upstream_tasks=[a])
Kevin Kho
a
to fully complete before b
,
a = A.map(...)
b = B.map(..., upstream_tasks=[unmapped(a)])
where unmapped
is imported from Prefect.Zac Chien
08/26/2021, 3:38 AM