Nivi Mukka

    Nivi Mukka

    1 year ago
    Hello Team, using Prefect Server (version 0.14.1) with Dask Gateway. I keep seeing this error after building the Docker image and registering the flow. Any insights into what might be causing this?
    dask_gateway.client.GatewayClusterError: Cluster 'dask-gateway.227aa200f55a45a091b3cf6a0d037563' failed to start, see logs for more information
    Here are more details from GKE logs:
    Last working version of Prefect Flow was using
    conda
    in the Dockerfile, now it is using
    pip
    to install all packages.
    Kevin Kho

    Kevin Kho

    1 year ago
    Hey @Nivi Mukka, what is your click version?
    Nivi Mukka

    Nivi Mukka

    1 year ago
    Hi @Kevin Kho, not sure I am using click. Where can I check that?
    Zach Angell

    Zach Angell

    1 year ago
    :upvote: and distributed version https://github.com/dask/dask/issues/7658
    Nivi Mukka

    Nivi Mukka

    1 year ago
    dask-gateway==0.9.0
    dask==2020.12.0
    distributed==2020.12.0
    Kevin Kho

    Kevin Kho

    1 year ago
    pip show click
    in the environment maybe? Prefect needs click for the CLI
    Nivi Mukka

    Nivi Mukka

    1 year ago
    click==7.1.2
    this is in the GCP Notebook Instance, which is where I am doing the build and pushing flow to Prefect
    Kevin Kho

    Kevin Kho

    1 year ago
    How about in the image?
    Nivi Mukka

    Nivi Mukka

    1 year ago
    I am installing all the packages using
    pip
    now instead of
    conda
    because of Ananconda’s commercial license.
    Zach Angell

    Zach Angell

    1 year ago
    If you're using Prefect 0.14.1, the latest version of
    click
    will be installed as a dependency, meaning
    click 8.0
    or higher
    Nivi Mukka

    Nivi Mukka

    1 year ago
    Should I install
    click
    in my Dockerfile explicitly?
    Zach Angell

    Zach Angell

    1 year ago
    Yeah that should do it
    Nivi Mukka

    Nivi Mukka

    1 year ago
    Okay, will give it a shot!
    Which version do you recommend?
    Kevin Kho

    Kevin Kho

    1 year ago
    Anything below
    8.0
    i think
    Nivi Mukka

    Nivi Mukka

    1 year ago
    Added
    click==7.1.2
    to my Dockerfile and that was the fix, thank you so much!