Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi. Is it possible to restrict number of parallel map tasks with DaskExecutor?

It would be by limiting the number of threads/processes when creating the Executor. We also do have <https://docs.prefect.io/orchestration/flow-runs/concurrency-limits.html#task-run-limits|task run> concurrency limiting on Prefect Cloud tho

But Prefect will use all available threads/processes in the Dask cluster.

I think only second approach will work for me

Oh you already have a cluster you just connect to?