Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Is there a way to set a concurrency limit on a flow for its sub-flows? e.g a flow that kicks off 20 sub-flows, but I only want 10 of them to run at a time.

one potential option i was thinking about if it is possible would be to create a new work queue for a flow's sub-flows at run-time, queue up the sub-flows to that work queue and set a concurrency limit on that queue

There is global concurrency and deployment concurrency.  Maybe one of those would help?