https://prefect.io
Join Slack
Prefect 2 Cloud - Instant "Crashed" State Hello everyone! :wave: I'm currently using Prefect Cloud...
# ask-community
s
Prefect 2 Cloud - Instant "Crashed" State Hello everyone! 👋 I'm currently using Prefect Cloud UI with K8s cluster where our agent deployed. It works fine, but some rare flows are getting crushed without any reasons. Event Feed shows it like 
SCHEDULED
-> 
PENDING
-> 
CRASHED
states and that's all. Prefect agent has no messages about crushed flow run as if this run didn't happen. May it be passible that agent wasn't able to receive the flow? I'll provide some extra details below ⤵️ Thx for attention!
Event Feed looks like (I've removed some sensitive info about my account): Flow run pending prefect.flow-run.Pending
Copy code
{
  "event": "prefect.flow-run.Pending",
  "occurred": "2024-08-02T10:55:19.725Z",
  "payload": {
    "intended": {
      "from": "SCHEDULED",
      "to": "PENDING"
    },
    "initial_state": {
      "type": "SCHEDULED",
      "name": "Scheduled",
      "message": "Flow run scheduled"
    },
    "validated_state": {
      "type": "PENDING",
      "name": "Pending"
    }
  },
  "received": "2024-08-02T10:55:20.250Z",
  "related": [
    {
      "prefect.resource.id": "prefect.schedule.b6a6733b-c11f-4772-b641-1d82f9c58648",
      "prefect.resource.role": "creator",
      "prefect.resource.name": "IntervalSchedule"
    }
  ],
  "resource": {
    "prefect.resource.id": "prefect.flow-run.5cb7107b-aa04-4597-a7b3-a759e0abf8e6",
    "prefect.resource.name": "manipulative-pigeon",
    "prefect.state-message": "",
    "prefect.state-name": "Pending",
    "prefect.state-timestamp": "2024-08-02T10:55:19.725360+00:00",
    "prefect.state-type": "PENDING"
  },
  "workspace": "21b03e33-1cd9-4b21-9305-7e4dbb7339d9"
}
Flow run crashed prefect.flow-run.Crashed
Copy code
{
  "event": "prefect.flow-run.Crashed",
  "occurred": "2024-08-02T10:55:20.586Z",
  "payload": {
    "intended": {
      "from": "PENDING",
      "to": "CRASHED"
    },
    "initial_state": {
      "type": "PENDING",
      "name": "Pending"
    },
    "validated_state": {
      "type": "CRASHED",
      "name": "Crashed",
      "message": "Flow run could not be submitted to infrastructure"
    }
  },
  "received": "2024-08-02T10:55:21.088Z",
  "related": [
    {
      "prefect.resource.id": "prefect.schedule.b6a6733b-c11f-4772-b641-1d82f9c58648",
      "prefect.resource.role": "creator",
      "prefect.resource.name": "IntervalSchedule"
    }
  ],
  "resource": {
    "prefect.resource.id": "prefect.flow-run.5cb7107b-aa04-4597-a7b3-a759e0abf8e6",
    "prefect.resource.name": "manipulative-pigeon",
    "prefect.state-message": "Flow run could not be submitted to infrastructure",
    "prefect.state-name": "Crashed",
    "prefect.state-timestamp": "2024-08-02T10:55:20.586985+00:00",
    "prefect.state-type": "CRASHED"
  },
  "workspace": "21b03e33-1cd9-4b21-9305-7e4dbb7339d9"
}
And I can't see any messages related to the crushed flow in the Prefect agent logs since the agent started 🧐 Flow Run ID was:
Copy code
5cb7107b-aa04-4597-a7b3-a759e0abf8e6
2 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by