Peter Roelants05/21/2021, 1:20 PM
minutes ◦ Calls flow_B
◦ Run with
to limit parallelism to max
runs at a time. For one scheduled run, the dependent flow flow_B is limited to run max
at a time. Now, I noticed that for a single run of flow_A, flow_B is indeed limited to a parallelism of
runs at one time. However, when a previous flow_A (and dependent *flow_B*s) are still running), and a new flow_A, with new dependent *flow_B*s are scheduled than more than
*flow_B*s can run at the same time. For example with parallelism `y=2`: • At time 1 there will be 2 *flow_B*s runing.
• At time 2 there will be 4 *flow_B*s runing.
Run flow_A 1: |--dependent flow_B 1: running |--dependent flow_B 2: running |--dependent flow_B 3: waiting
Is it possible to limit the parallelism of flow_B to max
Running flow_A-1: |--dependent flow_B-1: finished |--dependent flow_B-2: running |--dependent flow_B-3: running Run flow_A-2: |--dependent flow_B-4: running |--dependent flow_B-5: running |--dependent flow_B-6: waiting
over all scheduled runs?
Kevin Kho05/21/2021, 1:27 PM
Peter Roelants05/21/2021, 1:45 PM
Peter Roelants05/21/2021, 5:56 PM
Kevin Kho05/21/2021, 6:31 PM