Hi all, does anyone know if there is a parameter for the job that can be set to “allow to fail”
Not to get confused, the use case is different
We are running some validations during our complete etl flow, orchestrated in Prefect
one of the flows is this validations, but if any of the validation is false, the flow will fail and also the entire job and that we would like to avoid
so our steps are, we trigger one flow consisting on 5 different flows in cycle:
1. calculations finish
2. load finish
3. data transfer finish
4. validations finish (found one error but it finished the job) - after that everything fail, next job is not triggered
we would like to be able to trigger the next job even if the validation founds some errors, since it will trigger Slack webhook and inform us, and we can sort the error, but our job will continue
is something like this possible