Sumant Agnihotri
05/09/2022, 5:31 PMa()
b()
c()
each of which waits for 2 secs and prints the current time.
Next, I created the following flows:
with Flow("flow-a") as flow_a:
a()
b()
with Flow("parent-flow") as flow:
c()
flow_a.run(executor=LocalDaskExecutor())
flow.run(executor=LocalDaskExecutor())
Here, to my surprise, task a
and b
run first, then after 2 seconds task c
runs.
Example o/p:
b: 23:04:32
a: 23:04:32
c: 23:04:34
I want all 3 to run parallelly, what am I doing wrong? (Sorry, if this is not the right forum to ask these questions.)Kevin Kho
create_flow_run
task.
Maybe 2.0 will suit your needs more? You can try it there. The default task runner is the ConcurrentTaskRunner
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by