Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
j
Joshua Greenhalgh
05/22/2022, 2:45 PMSomething strange happened with one of my flow runs today and I wonder if anyone could help me understand? A flow was supposed to start on the hour but didn't actually start until 40 mins later - I am running on k8s - this is the logs for the agent;
[2022-05-22 10:38:54,107] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:45:23,307] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:49:21,934] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:52:35,355] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:52:52,891] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:55:50,229] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 10:58:57,882] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:01:55,170] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:03:51,118] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:03:51,120] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:04:20,396] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:06:38,595] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:11:22,056] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:14:13,378] ERROR - agent | Failed to query for ready flow runs
[2022-05-22 11:27:32,034] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:27:32,608] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:28:29,752] INFO - agent | Deploying flow run 42168215-28d2-45e6-9954-a576f7652955 to execution environment...
[2022-05-22 11:28:30,337] INFO - agent | Completed deployment of flow run 42168215-28d2-45e6-9954-a576f7652955
[2022-05-22 11:41:00,593] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:41:01,129] INFO - agent | Completed deployment of flow run 8e40b981-36a9-4183-9b13-a349983c4c41
[2022-05-22 11:46:44,471] INFO - agent | Deploying flow run 8e40b981-36a9-4183-9b13-a349983c4c41 to execution environment...
[2022-05-22 11:46:44,948] INFO - agent | Completed deployment of flow run 8e40b981-36a9-4183-9b13-a349983c4c41This is the data I see about when it ran in the UI;
Scheduled Start Time
22 May 2022 12:00pm
Started
22 May 2022 12:43pm
Ended
22 May 2022 12:49pm
Duration
5 minutes, 48 secondsk
Kevin Kho
05/22/2022, 2:46 PMI think this was the incident earlier this morning?
j
Joshua Greenhalgh
05/22/2022, 2:46 PMAhhh ok!!
That makes sense - is there a place to check for these thiungs?
k
Kevin Kho
05/22/2022, 2:46 PMYeah. https://prefect.status.io/
🙌 1
j
Joshua Greenhalgh
05/22/2022, 2:47 PMDid something similar happen on 20th?
Seems not - I had same kind of delay same time of day
k
Kevin Kho
05/22/2022, 3:08 PMI don’t think so really. We did have some performance spike but I don’t think service degraded. Did you have a delay any other day?
j
Joshua Greenhalgh
05/23/2022, 8:09 AMonly those