What is the recommended way to build a flow-of-flows dependency in the Orion Beta? IE, I want my dbt build flow to kick off only after the upstream ingestion flows complete.
I suppose I could try to make everything that has dependencies in the same flow, but that will eventually lead to a massive single flow with scores of tasks. It seems like it'd be better to keep them modular with cross-flow dependencies, what does the community think?
k
Kevin Kho
06/27/2022, 3:32 AM
You could use subflows or you can trigger a deployment from a parent flow
t
Travis Leleu
06/27/2022, 5:15 AM
Thanks for the info! The deployment link doesn't work - says it's Private or no longer exists, and I wasn't able to find in a search. Do you have another link? I think triggering a deployment upon successful completion of a parent is what I want.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.