Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by
Title
v
Vadym Dytyniak
05/19/2022, 3:18 PM
Hi. Is it possible to restrict number of parallel map tasks with DaskExecutor?
k
Kevin Kho
05/19/2022, 3:32 PM
It would be by limiting the number of threads/processes when creating the Executor. We also do have
task run
concurrency limiting on Prefect Cloud tho
v
Vadym Dytyniak
05/19/2022, 3:34 PM
But Prefect will use all available threads/processes in the Dask cluster.
I think only second approach will work for me
k
Kevin Kho
05/19/2022, 3:35 PM
Oh you already have a cluster you just connect to?
v
Vadym Dytyniak
05/19/2022, 3:36 PM
correct
2 Views
#prefect-community
Join Slack