Dylan Lim

01/09/2023, 1:53 AM
[Prefect 1.0] Hi all, we’ve encountered an issue since 4th January where one of our Flows runs indefinitely at the extract stage. For context, the Flow extracts records from another db using
, transforms it and loads it onto our warehouse using
. The Flow gets stuck at the stage where it reads from the external db and when I cancel it via the UI, it also cancels indefinitely (I have flows that have been ‘cancelling’ since a few days ago). Can anyone point me towards any suggested areas to investigate? For context, I checked if it’s a volume issue but the number of rows historically retrieved are roughly the same amount, and other Flows that query from the same external db are not running into this issue.

Christopher Boyd

01/10/2023, 2:35 PM
Where does the flow run from?
is this local, VM, kubernetes, docker?

Dylan Lim

01/11/2023, 2:37 AM
It’s running on a VM. No docker/kubernetes, the only difference between the VM flow and the local flow (that works) is that the local one runs directly while the VM one registers the flow to run automatically. I ran it a few more times and noticed that it is taking a bit longer on local than usual (>3 minutes), while the VM one just doesn’t complete even after a few days. Are there any timeouts on prefect cloud that I’m unaware of?