Nimesh Kumar

01/25/2023, 3:53 AM
Naive Question, How does the prefect work queues process the job, like i have a inferencing pipeline set with 1 work-queue, so if inferencing got triggered from let say 10 source then how will the queue handle it, is it do round-robin, sequentially or something else ?

Kalise Richmond

01/26/2023, 6:39 PM
Hi @Nimesh Kumar, the work queue will go by scheduled start time. So let's say your flow infrenencing gets triggerd from 10 different sources, that would create 10 different flow runs and based on the scheduled start time (which could be immediate) it would be put into the work queue which the agent would pull from. Here's a doc that. might help.

Nimesh Kumar

01/27/2023, 2:42 PM
Hi Kalise, Thank you for your response. I read the link you provided, and my understanding is that "we can set the queue's concurrency, and the number that we define for the concurrency will be equal to the number of concurrent flows execution." And by doing that we dont have a concept of queue management logic like round-robin, sequential etc. Am i Right? If yes, than is there a way i can decide the number for the concurrency ?