We are running our jobs on the Dask executor, in a pre-created Dask cluster. Are there any recommendations on how to scale the cluster with workloads or for added parallelism? (Ours run on Kubernetes).
1 year ago
Hey @Filip Lindvall, I am not 100% but I think this is stuff that is configured upon cluster creation