Good morning. Wondering if anyone has come across this issue when using
prefect-dask
. We seem to be getting a big number of what looks like the ephemeral cluster shutting down early (Stack trace in the thread) which then leads into the flow crashing.
Any help greatly appreciated
Josh Paulin
04/12/2023, 1:21 PM
Copy code
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/distributed/client.py", line 1681, in _close
await self.scheduler_comm.close()
asyncio.exceptions.CancelledError
13:04:47.906 | ERROR | distributed.client -
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/distributed/client.py", line 1681, in _close
await self.scheduler_comm.close()
asyncio.exceptions.CancelledError
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.