seto
11/12/2025, 4:00 PMMarvin
11/12/2025, 4:02 PMMarvin
11/12/2025, 4:06 PMPREFECT_RUNNER_HEARTBEAT_FREQUENCY.
2) If you need “Failed” instead of “Crashed”
- From Prefect’s perspective, SIGKILL is an infra issue, so the terminal state is Crashed. If your downstream expects Failed, add an automation:
- Trigger: Flow run enters state Crashed
- Action: Change flow run state to Failed
- Or just handle Crashed the same as Failed in your alerting/pipelines.
- State docs: Prefect states in 3.x
3) Investigate the cause of the SIGKILL
- On Kubernetes: check the Pod’s termination reason (e.g., OOMKilled) and adjust requests/limits upward.
- Local/VM: check dmesg/syslog for OOM killer messages and increase memory or reduce workload.
Helpful CLI
- You can inspect existing automations:
prefect automation ls
(We verified this command exists.)
A couple clarifying questions so I can be more specific:
- Which Prefect version are you on (assuming 3.x unless you say otherwise)?
- What infrastructure are you running on (Process, Docker, Kubernetes)? If K8s, do you see OOMKilled in the pod status?
- Did the run end up Crashed, or did it remain Running with no final state?
- Rough timestamp or a flow run ID we can reason about?Nate
11/12/2025, 5:45 PM