Hi all! Just wondering if anyone has noticed memory leaking when using prefect with dask workers? I am already deleting the local flow variables, calling gc.collect(), and have completely disabled checkpointing with prefect. And yet, this is typical for my workers until the OOM and die over the course of a few days. All the little bumps and step ups lines (green, red, blues) at the top are the dask workers in the swarm that keep growing.

Hey @Samuel Hinton, have you sen this video? Maybe you can try setting the env variable there to decrease unmanaged memory? Also, I believe Dask has upgrades in 2021.6 around memory management so it might be worth the upgrade?

Hi Kevin, looks like the video didnt link properly. Ill upgrade Dask as well (though I am on 2021.06 now) and see if that helps!