I know you can leverage concurrency with the ConcurrentTaskRunner, but what if i've adopted the flow of flows pattern. Is there a way to do a flow.submit to run two subflows concurrently?
Tom Matthews
11/15/2023, 4:48 PM
Aha i can see from the docs:
Copy code
Subflows will block execution of the parent flow until completion. However, asynchronous subflows can be run in parallel by using AnyIO task groups or asyncio.gather.
So my flow would have to be async
Tom Matthews
11/15/2023, 4:49 PM
And if its async i can just use standard asyncio concurrency paradigms
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.