or adding other env variables (though I guess in your case you could do it in the executor.
You can also provide an image to KubernetesRun so that it’ll match the Dask cluster? Like if you start to use
pandas
or
numpy
in your Flow, I think you’ll need to match versions between the client and workers.
w
Wilson Bilkovich
08/23/2021, 3:50 PM
So, when I specify a pod template (image) on DaskExecutor, KubernetesRun is still happening and using a different image?
k
Kevin Kho
08/23/2021, 3:53 PM
I think the image on the DaskExecutor is for the scheduler and workers, but the KubernetesRun image for the client.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.