Has anyone configured DaskTaskRunner in prefect? I...
# prefect-cloud
g
Has anyone configured DaskTaskRunner in prefect? I don't have a dedicated Dask cluster right now since I was hoping to see how Prefect could spin up a temporary one in my worker, though I kept experiencing crashes with the following error messages:
Process for flow run 'quiet-carp' exited with status code: -9; This indicates that the process exited due to a SIGKILL signal. Typically, this is either caused by manual cancellation or high memory usage causing the operating system to terminate the process.
I'm open to using a cloud Dask cluster if anyone has recommendations
k
How is your worker set up, and what type of worker is it?