https://prefect.io logo
Title
v

Vadym Dytyniak

05/19/2022, 3:18 PM
Hi. Is it possible to restrict number of parallel map tasks with DaskExecutor?
k

Kevin Kho

05/19/2022, 3:32 PM
It would be by limiting the number of threads/processes when creating the Executor. We also do have task run concurrency limiting on Prefect Cloud tho
v

Vadym Dytyniak

05/19/2022, 3:34 PM
But Prefect will use all available threads/processes in the Dask cluster.
I think only second approach will work for me
k

Kevin Kho

05/19/2022, 3:35 PM
Oh you already have a cluster you just connect to?
v

Vadym Dytyniak

05/19/2022, 3:36 PM
correct