Hello prefecteers! I'm having some trouble with what appears to be a deadlock. I've gotten a minimum reproducible example that may or may not be the cause for my issue, which centers around tasks that submit additional work to the dask client which serves as the executor. I am using prefect core with the dask executor. Here is the example:

I think you need to run your dask client code in a

with worker_client

block. See https://distributed.dask.org/en/latest/task-launch.html#connection-with-context-manager

That has absolutely done it for the small testcase, thanks a ton Michael. I'll take it to the non-trivial case next!

@Marvin archive "Encountering deadlock using

dask.Client

in task"