@flow
def f():
a = subflow_foo.submit(1) # .submit() doesn't exist on Flow or run_deployment().
b = subflow_foo.submit(2)
c = subflow_foo.submit(3)
x = subflow_bar(a, b)
y = subflow_bar(b, c)
x.wait()
y.wait()
I want to get the engine's dependency tracking to kick off downstream sub-flows as soon as their dependencies are satisfied. It feels like I could wrap run_deployment() in a future myself, but maybe I'm missing some non-obvious reason this wouldn't work?
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.