https://prefect.io logo
Title
i

Ilya Galperin

04/27/2023, 11:17 PM
Hello - we are still experiencing degraded performance and late runs on Prefect Cloud 2.0 even after the issue was said to have been resolved at 22:29 UTC. Is anyone else also experiencing this and is there any update from the Prefect team?
āœ… 1
a

Aimee McManus

04/28/2023, 12:14 AM
Hi Ilya - I'm really sorry to hear you're experiencing degraded performance and late runs. We haven't received reports of similar behavior from other users and as such we don't believe it is related to the issue from earlier today; that said we're investigating and will follow up with more info as soon as possible. CC @Emil Christensen
i

Ilya Galperin

04/28/2023, 12:23 AM
Thanks Aimee.
b

Bianca Hoch

04/28/2023, 12:31 AM
Hi Ilya, while the team is investigating, I thought I would chime in here. Another user reported that turning the schedule off and on for their flows helped clear up the issue. It may be worth a try to see if it helps
i

Ilya Galperin

04/28/2023, 12:54 AM
Thanks Bianca - one of the deployments we tried this on is not scheduled but I can try it on another and see if it changes anything.
Just tried deleting the schedule, re-adding it then running again to no avail unfortunately.
b

Bianca Hoch

04/28/2023, 12:58 AM
It immediately becomes late after re-enabling the schedule?
i

Ilya Galperin

04/28/2023, 1:28 AM
Yes pretty much immediately
Hi all - any update here? Thank you!
e

Emil Christensen

04/28/2023, 11:54 AM
Hi @Ilya Galperin šŸ‘‹ Are you still experiencing serbice degredation? If so, can you send me an example deployment or flow run ID? Looks like we declared and then resolved another incident last evening.
i

Ilya Galperin

04/28/2023, 3:59 PM
Hi Emil. Restarting our agent this morning seems to have picked up stalled jobs.
āœ… 1
e

Emil Christensen

04/28/2023, 6:23 PM
Glad to hear it! One thing Iā€™d recommend is to update your agent to version 2.10.5 or later, which includes a patch to the agent.
šŸ‘ 1