Channels
#prefect-community
Title
# prefect-community
j
Joshua Greenhalgh
05/22/2022, 2:45 PMSomething strange happened with one of my flow runs today and I wonder if anyone could help me understand? A flow was supposed to start on the hour but didn't actually start until 40 mins later - I am running on k8s - this is the logs for the agent;
Copy code
[2022-05-22 10:38:54,107] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:45:23,307] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:49:21,934] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:52:35,355] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:52:52,891] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:55:50,229] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:58:57,882] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:01:55,170] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:03:51,118] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:03:51,120] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:04:20,396] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:06:38,595] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:11:22,056] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:14:13,378] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:27:32,034] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:27:32,608] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:28:29,752] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:28:30,337] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:41:00,593] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:41:01,129] INFO - agent | Completed deployment of flow run 8e40b981-36a9-4183-9b13-a349983c4c41
[2022-05-22 11:46:44,471] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:46:44,948] INFO - agent | Completed deployment of flow run 8e40b981-36a9-4183-9b13-a349983c4c41This is the data I see about when it ran in the UI;
Copy code
Scheduled Start Time
22 May 2022 12:00pm
Started
22 May 2022 12:43pm
Ended
22 May 2022 12:49pm
Duration
5 minutes, 48 secondsk
Kevin Kho
05/22/2022, 2:46 PM
I think this was the incident earlier this morning?
j
Joshua Greenhalgh
05/22/2022, 2:46 PMAhhh ok!!
That makes sense - is there a place to check for these thiungs?
k
Kevin Kho
05/22/2022, 2:46 PM
🙌 1
j
Joshua Greenhalgh
05/22/2022, 2:47 PMDid something similar happen on 20th?
Seems not - I had same kind of delay same time of day
k
Kevin Kho
05/22/2022, 3:08 PM
I don’t think so really. We did have some performance spike but I don’t think service degraded. Did you have a delay any other day?
j
Joshua Greenhalgh
05/23/2022, 8:09 AMonly those
4 Views