Hey! 🙋♂️
We’re trying to use this (excellent) example:
https://github.com/anna-geller/packaging-prefect-flows/blob/master/flows_task_library/s3_kubernetes_run_RunNamespacedJob_and_get_logs.py
And we’re missing some permissions on our end for K8s operations -
however, I noticed that when i ran this flow --- even though the first step (delete k8s job) failed, it proceeded to perform the next steps (e.g. create job, which it does have permissions for)
am i missing something about how this should work?
shouldn’t a failure in a task lead to halting the entire flow (by default, without explicitly playing with triggers)?
Tom Klein
01/17/2022, 11:51 AM
Tom Klein
01/17/2022, 11:51 AM
a
Anna Geller
01/17/2022, 11:59 AM
The reason for this is that I explicitly specified the all_finished trigger for this task. If you remove this line, all downstream tasks should immediately fail with TriggerFailed state.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.