Following on from the above, my flows are annotated with:
Copy code
@flow(timeout_seconds=3600)
And yet I can see there are flows that have been in running for literally months. Im a bit confused as to how flows marked with a one hour timeout can be running for so long - has the way of declaring flows to timeout changed recently?? Now I dont have the workers available on the dask cluster to actually have hundreds of flows running, so I assume the tasks either finished/crashed/timed out, but prefect hasn't moved the actual state of the parent flow. Confused about how I can ensure this stops happening
Samuel Hinton
03/08/2024, 5:42 AM
Flows running, oldest to earliest, and screenshot of the flow signature
j
Jessica Smith
03/08/2024, 2:20 PM
Is it actually running or is it dead and the state just hasn't updated?
s
Samuel Hinton
03/10/2024, 10:25 PM
The ones shown here should be very dead and its just prefect's state which isnt updating
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.