Adam

    Adam

    2 years ago
    Hi everyone, a quick question. What is the relation between the Docker container and Dask? I'm struggling to make the link between the two. To my knowledge Dask is not aware of containers? (I've never used Dask but used k8s/docker extensively so just looking to find the link between how the container is run against Dask)
    Chris White

    Chris White

    2 years ago
    Hi @Adam - it is best practice to have the same python package versions + environment on your client + all Dask workers. Docker makes this very easy to do if all the workers share a common image.
    Adam

    Adam

    2 years ago
    Thanks @Chris White, where would one specify that image? In the yaml for setting up the dask workers?
    Chris White

    Chris White

    2 years ago
    That depends on how you are creating your Dask cluster; if you are using a k8s manifest (which it sounds like you are based on your mention of yaml) then yea that would be a good place to configure the image