Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
a
Alfie
09/06/2021, 1:47 PMHi Team, I see an issue in my Prefect server (0.13.10) environment. When the flow is removed during execution, there are a lot of errors reported and it will not stop. Is this an known issue?
prefect.utilities.exceptions.ClientError: Flow run ID not found: "3b51f006-cbbe-459c-b74f-6a832f22db96"Errors are like this:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/prefect/engine/cloud/flow_runner.py", line 179, in interrupt_if_cancelling
flow_run_info = self.client.get_flow_run_info(flow_run_id)
File "/usr/local/lib/python3.9/site-packages/prefect/client/client.py", line 1004, in get_flow_run_info
raise ClientError('Flow run ID not found: "{}"'.format(flow_run_id))
[2021-09-03 09:52:20] warning - prefect.CloudFlowRunner | Error getting flow run info
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/prefect/engine/cloud/flow_runner.py", line 179, in interrupt_if_cancelling
flow_run_info = self.client.get_flow_run_info(flow_run_id)
File "/usr/local/lib/python3.9/site-packages/prefect/client/client.py", line 1004, in get_flow_run_info
raise ClientError('Flow run ID not found: "{}"'.format(flow_run_id))
prefect.utilities.exceptions.ClientError: Flow run ID not found: "3b51f006-cbbe-459c-b74f-6a832f22db96"k
Kevin Kho
09/06/2021, 4:53 PMWhy is the flow getting removed here? I think this would be expected if you’re deleting a flow mid run because you’re removing it from the database, but the flow is updating states of tasks in the database using the flow run ID. Does that make sense?
a
Alfie
09/07/2021, 2:00 AMThanks @Kevin Kho, it’s fine to report the error and stop. But my concern is the agent keeps reporting the error like in a dead loop.
k
Kevin Kho
09/07/2021, 2:28 AMAh ok. Will try this myslef tomorrow
👍 1
I replicated this on KubernetesRun by checking the logs of my pod, but could not replicate in with LocalRun. Just checking if you’re using Kubernetes?
We’ll open a ticket for this to fix it
a
Alfie
09/09/2021, 8:46 AMThanks @Kevin Kho, yes I run it in Kubernetes
k
Kevin Kho
09/09/2021, 2:01 PMThe issue is here
a
Alfie
09/13/2021, 5:32 AMThanks @Kevin Kho! is there a plan to get it fixed?
k
Kevin Kho
09/13/2021, 5:35 AMI can’t give a timeline on this honestly as I have no idea how involved the fix is. I may have an answer for you on tuesday. Let’s see if the core team chimes in on that issue in a bit.
a
Alfie
09/13/2021, 8:45 AMI see, thanks a lot