Jake
04/21/2022, 3:58 PMAttributeError: 'V1Job' object has no attribute 'name'
and I’m not sure what this means. Prefect cloud is reporting that No heartbeat detected from the remote task; marking the run as failed.
This is a Kubernetes Agent. I looked at the logs and here is a stack trace:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/prefect/agent/kubernetes/agent.py", line 413, in heartbeat
self.manage_jobs()
File "/usr/local/lib/python3.6/site-packages/prefect/agent/kubernetes/agent.py", line 193, in manage_jobs
ERROR:agent:Error while managing existing k8s jobs
Traceback (most recent call last):
f"Job {job.name!r} is for flow run {flow_run_id!r} "
AttributeError: 'V1Job' object has no attribute 'name'
File "/usr/local/lib/python3.6/site-packages/prefect/agent/kubernetes/agent.py", line 190, in manage_jobs
flow_run_state = self.client.get_flow_run_state(flow_run_id)
File "/usr/local/lib/python3.6/site-packages/prefect/client/client.py", line 1664, in get_flow_run_state
raise ObjectNotFoundError(f"Flow run {flow_run_id!r} not found.")
prefect.exceptions.ObjectNotFoundError: Flow run 'af8b8a74-8ed0-4417-812a-566de859ce64' not found.
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/prefect/agent/kubernetes/agent.py", line 413, in heartbeat
self.manage_jobs()
File "/usr/local/lib/python3.6/site-packages/prefect/agent/kubernetes/agent.py", line 193, in manage_jobs
f"Job {job.name!r} is for flow run {flow_run_id!r} "
AttributeError: 'V1Job' object has no attribute 'name'
Deleting the Agent pod did not solve the issue. Any ideas?Kevin Kho
04/21/2022, 4:00 PMJake
04/21/2022, 4:06 PMKevin Kho
04/21/2022, 4:07 PMJake
04/21/2022, 4:12 PMFile "/usr/local/lib/python3.6/site-packages/prefect/client/client.py", line 1664, in get_flow_run_state
raise ObjectNotFoundError(f"Flow run {flow_run_id!r} not found.")
prefect.exceptions.ObjectNotFoundError: Flow run 'ed00b008-7224-4386-bea3-707684420326' not found.
Kevin Kho
04/21/2022, 5:35 PMAnna Geller
04/21/2022, 6:31 PMJake
04/21/2022, 9:43 PMAnna Geller
04/21/2022, 10:37 PMJake
04/22/2022, 3:18 PMprefect.exceptions.ObjectNotFoundError: Flow run '0758ed94-ebda-44c4-a439-e698af7cb675' not found.
It’s being emitted by the agent on our cluster. I’m not sure if there is something wrong on the cloud side. This is the flow run id for a job that was completed about 8 days ago. Searching for this ID in prefect cloud has no results.Anna Geller
04/22/2022, 3:33 PMJake
04/22/2022, 4:45 PM0.15.4
. Thanks!