Chris Goddard
05/26/2023, 6:08 PMmain
function - with everything else being plain async python) and i’m still getting random hangs — and when I kill the script, it seems (as best as I can tell), that the KeyboardInterrupt
gets caught somewhere within the prefect codebase.
what is curious is that when I dropped the top-level @flow
altogether and just ran as a plain python script, it hasn’t stalled yet (will update if it does).
is it possible that there’s something going on with longer-running (5min+) async flows that’s causing them to hang at some point? I thought maybe it was to do with hitting the logging rate limit but by removing all of the task decorators I’ve managed to limit the overall prefect calls significantly.
I’m racking my brain at this point. anyone have any experience with long-running async programs? are there other factors that could be causing random hangs?Zanie
05/26/2023, 6:21 PMpy-spy dump
of the process when it’s stuckOuail Bendidi
05/26/2023, 7:15 PM