Hi, am wondering if there is any way to control the priority of scheduled/queued flows? We have some fairly bursty workloads where we are compute limited (planning to limit number of flows per agent) and so want the option to occasionally submit new flow runs with a higher priority. The only thing I can think of is maybe using agent labels which doesn't feel like the right way!
k
Kyle Moon-Wright
03/15/2021, 3:39 PM
Hey @Ross,
I know some users have had success with using Flow Concurrency Limiting via labels to ensure there is always an available flow concurrency slot available to run priority flows, however I think you’ll have a lot more flexibility once success-based usage of Cloud goes live and you are no longer constrained by flow execution concurrency.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.