https://prefect.io logo
Title
s

Sachit Shivam

09/06/2020, 6:29 PM
Hey guys Is it possible to connect to more than one Dask cluster as the executor?
c

Chris White

09/06/2020, 7:05 PM
Hi Sachit - can you explain your use case? I’m not sure using two dask clusters makes sense or provides any benefit over scaling out a single cluster
s

Sachit Shivam

09/09/2020, 3:37 AM
Can specific tasks use a different executor?
c

Chris White

09/09/2020, 3:53 AM
Not currently - could you elaborate on your use case?
s

Sachit Shivam

09/09/2020, 8:13 AM
Some of our clients need us to run jobs on their own infrastructure, so we were trying to figure out if we can program that kind of behaviour in a Flow
c

Chris White

09/09/2020, 1:15 PM
You don’t need to configure an executor for that - you could use different agents with different labels to route certain flows to certain execution infrastructure
s

Sachit Shivam

09/09/2020, 2:00 PM
Okay, I'll go through the docs and try to figure it out. Thank you for your time!