Is there any way to have a Flow only run a portion of the dag? And if so, is it possible to have a Schedule that only runs a portion of the dag?
n
nicholas
01/15/2021, 9:44 PM
Hi @Joseph - this isn't possible right now but is something we've heard a lot of support for and are looking into.
j
Joseph
01/15/2021, 9:44 PM
Ok, thanks
n
nicholas
01/15/2021, 9:46 PM
One pattern we've seen evolve is that of an "Orchestrator Flow", which is one that could conditionally kick off runs of other flows. So in a pattern like that, you could break out portions of your flow that you might want to run on a schedule into their own flow, and when they need to be run as part of a larger diagram you would use a
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.