Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Is there a way to limit the number or resource of parallel tasks in DaskTaskRunner?
I want to put restrictions on each name of task
The problem is that I want to avoid polling timeouts caused by too many tasks being scheduled.

I tried running subflows in parallel with the following reference, but the logs showed that only the first flow was being executed.
I couldn’t figure it out, so I implemented it so that it is executed separately as a completely separate flow.
<https://discourse.prefect.io/t/how-can-i-run-multiple-subflows-or-child-flows-in-parallel/96>