Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, is there a nice pod spec for setting up an ephemeral dask cluster using the latest prefect/prefect_dask versions?

Or maybe there is some up to date docs on setting up an ephemeral dask cluster using all the latest versions?

Hey Sander, check out these dask docs attached below.  <https://kubernetes.dask.org/en/latest/kubecluster.html#dask_kubernetes.KubeCluster>

I also attached a reference from our Prefect recipes page that goes over a dask executor example

<https://docs.coiled.io/user_guide/examples/prefect.html#using-the-daskexecutor>

Thanks for these recipes. I was also wondering if there is some ready made docket image with all the latest versions similar to this one <https://hub.docker.com/r/annageller/prefect-dask-k8s|https://hub.docker.com/r/annageller/prefect-dask-k8s>. Do you know <@U02H1A95XDW> ?