Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, I was wondering if there was a way to stop a scheduled flow if it failed X number of times?

Not the X number of times but there is an <https://docs.prefect.io/orchestration/concepts/automations.html|Automation> to pause a schedule.

I guess you could keep tally in the <https://docs.prefect.io/orchestration/concepts/kv_store.html|KV Store> and then hit the GraphQL API upon flow failure to pause the schedule too (don’t use automations)

Thanks <@U01QEJ9PP53> we're running Prefect in our own cluster. We had quite a few pods appear. Should Prefect clean these failed pods?

If they ended, I believe it’s cleaned up by k8s eventually

In case someone comes across this thread, we have added a pod quota limit to the namespace. We hope this will prevent prefect failed jobs from saturating the cluster.