Hey guys
Is it possible to connect to more than one Dask cluster as the executor?
c
Chris White
09/06/2020, 7:05 PM
Hi Sachit - can you explain your use case? I’m not sure using two dask clusters makes sense or provides any benefit over scaling out a single cluster
s
Sachit Shivam
09/09/2020, 3:37 AM
Can specific tasks use a different executor?
c
Chris White
09/09/2020, 3:53 AM
Not currently - could you elaborate on your use case?
s
Sachit Shivam
09/09/2020, 8:13 AM
Some of our clients need us to run jobs on their own infrastructure, so we were trying to figure out if we can program that kind of behaviour in a Flow
c
Chris White
09/09/2020, 1:15 PM
You don’t need to configure an executor for that - you could use different agents with different labels to route certain flows to certain execution infrastructure
s
Sachit Shivam
09/09/2020, 2:00 PM
Okay, I'll go through the docs and try to figure it out.
Thank you for your time!