Fabrice Toussaint

06/07/2021, 11:50 AM
Hi, I am trying to setup a Dask Executor but when try to deploy a flow using the DaskExecutor it says that Prefect cannot be found:
Unexpected error: ModuleNotFoundError("No module named 'prefect'")
I did specify Prefect in the environment variables of the pod specification, so I do not know why it cannot be found. If anyone can help me, please let me know 🙂. EDIT: Also I am using the KubeCluster class (dask_kubernetes.KubeCluster)


06/07/2021, 1:56 PM
Hi @Fabrice Toussaint - I'm not an expert at set-up with Dask but does the following link and discussion help?

Kevin Kho

06/07/2021, 3:18 PM
Hey @Fabrice Toussaint, you need to have prefect installed on the Dask workers. I assume your KubeCluster takes an image? Did you include prefect there? You can also use the base prefect image if you are using the base dask image because the base prefect image has dask