https://prefect.io logo
Title
d

Dylan Lim

01/09/2023, 1:53 AM
[Prefect 1.0] Hi all, we’ve encountered an issue since 4th January where one of our Flows runs indefinitely at the extract stage. For context, the Flow extracts records from another db using
PostgresFetch
, transforms it and loads it onto our warehouse using
PostgresExecuteMany
. The Flow gets stuck at the stage where it reads from the external db and when I cancel it via the UI, it also cancels indefinitely (I have flows that have been ‘cancelling’ since a few days ago). Can anyone point me towards any suggested areas to investigate? For context, I checked if it’s a volume issue but the number of rows historically retrieved are roughly the same amount, and other Flows that query from the same external db are not running into this issue.
c

Christopher Boyd

01/10/2023, 2:35 PM
Where does the flow run from?
is this local, VM, kubernetes, docker?
d

Dylan Lim

01/11/2023, 2:37 AM
It’s running on a VM. No docker/kubernetes, the only difference between the VM flow and the local flow (that works) is that the local one runs directly while the VM one registers the flow to run automatically. I ran it a few more times and noticed that it is taking a bit longer on local than usual (>3 minutes), while the VM one just doesn’t complete even after a few days. Are there any timeouts on prefect cloud that I’m unaware of?