https://prefect.io logo
Title
n

Nivi Mukka

09/17/2021, 8:26 PM
Hello Team, using Prefect Server (version 0.14.1) with Dask Gateway. I keep seeing this error after building the Docker image and registering the flow. Any insights into what might be causing this?
dask_gateway.client.GatewayClusterError: Cluster 'dask-gateway.227aa200f55a45a091b3cf6a0d037563' failed to start, see logs for more information
Here are more details from GKE logs:
Last working version of Prefect Flow was using
conda
in the Dockerfile, now it is using
pip
to install all packages.
k

Kevin Kho

09/17/2021, 8:27 PM
Hey @Nivi Mukka, what is your click version?
n

Nivi Mukka

09/17/2021, 8:29 PM
Hi @Kevin Kho, not sure I am using click. Where can I check that?
z

Zach Angell

09/17/2021, 8:29 PM
:upvote: and distributed version https://github.com/dask/dask/issues/7658
n

Nivi Mukka

09/17/2021, 8:29 PM
dask-gateway==0.9.0
dask==2020.12.0
distributed==2020.12.0
k

Kevin Kho

09/17/2021, 8:29 PM
pip show click
in the environment maybe? Prefect needs click for the CLI
n

Nivi Mukka

09/17/2021, 8:31 PM
click==7.1.2
this is in the GCP Notebook Instance, which is where I am doing the build and pushing flow to Prefect
k

Kevin Kho

09/17/2021, 8:31 PM
How about in the image?
n

Nivi Mukka

09/17/2021, 8:32 PM
I am installing all the packages using
pip
now instead of
conda
because of Ananconda’s commercial license.
z

Zach Angell

09/17/2021, 8:32 PM
If you're using Prefect 0.14.1, the latest version of
click
will be installed as a dependency, meaning
click 8.0
or higher
n

Nivi Mukka

09/17/2021, 8:33 PM
Should I install
click
in my Dockerfile explicitly?
z

Zach Angell

09/17/2021, 8:33 PM
Yeah that should do it
n

Nivi Mukka

09/17/2021, 8:33 PM
Okay, will give it a shot!
Which version do you recommend?
k

Kevin Kho

09/17/2021, 8:34 PM
Anything below
8.0
i think
👍 2
n

Nivi Mukka

09/17/2021, 9:31 PM
Added
click==7.1.2
to my Dockerfile and that was the fix, thank you so much!
👍 2