José Duarte
08/22/2022, 2:02 PMEach work queue can optionally restrict concurrent runs of matching flows.Does this mean that if I have
Flow_A
and Flow_B
running, they can run concurrently for any concurrency limit value?Clint M
08/22/2022, 2:22 PMWork queue concurrency¶
Each work queue can optionally restrict concurrent runs of matching flows.
For example, a work queue with a concurrency limit of 5 will only release new work if fewer than 5 matching runs are currently in aorRunning
state. If 3 runs arePending
orRunning
, polling the queue for work will only result in 2 new runs, even if there are many more available, to ensure that the concurrency limit is not exceeded.Pending
When using thePrefect CLI command to configure a work queue, the following subcommands set concurrency limits:prefect work-queue
•sets a concurrency limit on a work queue.set-concurrency-limit
•clears any concurrency limits from a work queue.clear-concurrency-limit
José Duarte
08/22/2022, 2:25 PMClint M
08/22/2022, 2:36 PM