Hi, I'm trying to use DaskTaskRunner with KubeCluster. However the worker process in Dask tries to c...

Dmitry Golubets

09/06/2024, 12:02 PM

Hi, I'm trying to use DaskTaskRunner with KubeCluster. However the worker process in Dask tries to create KubeCluster again:

Copy code

prefect.task_runner.dask - Creating a new Dask cluster with `dask_kubernetes.operator.kubecluster.kubecluster.KubeCluster`

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.