Hi Team, I see an issue in my Prefect server (0.13...
# prefect-server
a
Hi Team, I see an issue in my Prefect server (0.13.10) environment. When the flow is removed during execution, there are a lot of errors reported and it will not stop. Is this an known issue?
prefect.utilities.exceptions.ClientError: Flow run ID not found: "3b51f006-cbbe-459c-b74f-6a832f22db96"
Errors are like this:
Copy code
Traceback (most recent call last):

File "/usr/local/lib/python3.9/site-packages/prefect/engine/cloud/flow_runner.py", line 179, in interrupt_if_cancelling

flow_run_info = self.client.get_flow_run_info(flow_run_id)

File "/usr/local/lib/python3.9/site-packages/prefect/client/client.py", line 1004, in get_flow_run_info

raise ClientError('Flow run ID not found: "{}"'.format(flow_run_id))

[2021-09-03 09:52:20] warning - prefect.CloudFlowRunner | Error getting flow run info

Traceback (most recent call last):

File "/usr/local/lib/python3.9/site-packages/prefect/engine/cloud/flow_runner.py", line 179, in interrupt_if_cancelling

flow_run_info = self.client.get_flow_run_info(flow_run_id)

File "/usr/local/lib/python3.9/site-packages/prefect/client/client.py", line 1004, in get_flow_run_info

raise ClientError('Flow run ID not found: "{}"'.format(flow_run_id))

prefect.utilities.exceptions.ClientError: Flow run ID not found: "3b51f006-cbbe-459c-b74f-6a832f22db96"
k
Why is the flow getting removed here? I think this would be expected if you’re deleting a flow mid run because you’re removing it from the database, but the flow is updating states of tasks in the database using the flow run ID. Does that make sense?
a
Thanks @Kevin Kho, it’s fine to report the error and stop. But my concern is the agent keeps reporting the error like in a dead loop.
k
Ah ok. Will try this myslef tomorrow
👍 1
I replicated this on KubernetesRun by checking the logs of my pod, but could not replicate in with LocalRun. Just checking if you’re using Kubernetes?
We’ll open a ticket for this to fix it
a
Thanks @Kevin Kho, yes I run it in Kubernetes
k
The issue is here
a
Thanks @Kevin Kho! is there a plan to get it fixed?
k
I can’t give a timeline on this honestly as I have no idea how involved the fix is. I may have an answer for you on tuesday. Let’s see if the core team chimes in on that issue in a bit.
a
I see, thanks a lot