Hello everyone , I have my prefect server running ...
# prefect-server
a
Hello everyone , I have my prefect server running on K8 with a k8 agent. I want to integrate a dask execution layer for the already deployed system. Can anyone guide me with a simple way to do that. Presently i register my flows from local machine and i am using git storage for storing scripts.
a
you can use DaskExecutor with a KubeCluster class as shown in this blog post https://medium.com/slateco-blog/prefect-x-kubernetes-x-ephemeral-dask-power-without-responsibility-6e10b4f2fe40