Ilya Galperin

01/11/2023, 4:28 PM
Hi all - we’re seeing sporadic
BrokenPipeError: [Errno 32] Broken pipe
crashes in one of our flows on 2.7.7, running on DaskTaskRunner. This flow runs ~1000 tasks, occasionally one of these tasks will enter a Crashed state with this error and cause our flow to enter a Failed state. Retries on these crashed tasks don’t seem to work (I’m guessing Crashed state tasks are excluded from retry logic). Full traceback in the thread. Any ideas? Thank you!