Hi - I'm trying to orchestrate a multi-step job in...
# ask-community
j
Hi - I'm trying to orchestrate a multi-step job in a nice way. I'd like to run each step on its Deployment's native infra/params/etc. but to chain them to get a kind of meta-Flow for running the whole job to have one overarching view. I could get the first part easily enough with run_deployment() in a Task. However, I am finding it tricky to ensure that if those subflows/sub-Deployments fail, the whole chaining meta-Flow fails as well. Right now, they don't seem to - I have cases where a subtask has failed but the whole job shows as Completed, not Failed. I would expect this to operate as, essentially, a monad. I feel like I'm missing a trick somewhere. Anyone here got any idea what it might be?
i
Hi @Jan Malek, Since these flows are in separate deployments, it's a great use-case for 'triggers', though a cloud only feature. Here's an example from a colleague to a similar question: https://prefect-community.slack.com/archives/C04DZJC94DC/p1693845403359129?thread_ts=1693842332.652039&cid=C04DZJC94DC
j
Thanks @Islam Otmani, but I'm afraid that we're invested in on-prem deployment at this point, and the behaviour I'm observing honestly almost seems like a bug