Hi everyone, Help!! We are still on Prefect 1 Our Prefect agent just started failing. It is sched...

Michael Duncan

12/08/2023, 11:37 PM

Hi everyone, Help!! We are still on Prefect 1 Our Prefect agent just started failing. It is scheduling flows and I can see the ECS tasks being started but the Prefect UI shows them as stuck in a scheduled state and late. Has anyone run into this before? This just started happening in all of our environments Has anyone run into this before? Is it somehow related to the new release today?

plus1 2

✅ 1

Jenny

12/09/2023, 12:54 AM

Thanks for flagging @Michael Duncan and @Brett Naul - let me check with the team and see if we have any idea what this might be.

Michael Duncan

12/09/2023, 1:21 AM

@Jenny If its helpful the flow code is running even though the UI says its stuck in a Scheduled state After the flow code is done running the container stays alive with this log over and over

Copy code

DEBUG - prefect.CloudFlowRunner | Checking flow run state...
WARNING - prefect.CloudFlowRunner | Flow run is no longer in a running state; the current state is: <Scheduled: "Flow run scheduled.">

Jenny

12/09/2023, 1:23 AM

Thanks Michael. We’re actively looking into it right now.

👍 1

Jenny

12/09/2023, 2:05 AM

Hi Michael and Brett - an update that we’ve identified the issue and resolved the root cause.

Jenny

12/09/2023, 2:06 AM

There may still be some latency while we look into the backlog of state updates.

Anthony Head

12/09/2023, 2:48 AM

@Michael Duncan Thank you for your patience, all systems are operational.

Tomas Moreno

12/09/2023, 3:54 AM

confirming for our team that everything is good! thank you jenny and anthony!

💙 2

4 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.