Hi Everyone, How can i implement round robin on pr...
# prefect-getting-started
n
Hi Everyone, How can i implement round robin on prefect For example let suppose i have 3 queue (q1, q2, q3) in the worker-pool with same priority and concurrency 1, is there a way it can pick one from q1 then from q2 and then from q3.
b
Hey Nimesh, qq before I give any suggestions, why 3 queues? are the 3 queues being polled by 3 separate workers?
n
3 is just a random number i took. Please allow me to explain my usecase Let say We have two sites, A and B, from which inference requests are being made. Site A has 1000 inference requests, while site B has 10. Currently, the 10 requests from site B are queued behind the 1000 requests from site A, causing unnecessary delays. What I aim to achieve is to enable these 10 requests from site B to proceed independently of the requests from site A, without having to wait for all 1000 requests to complete. So i was thinking like the number of queues need to be equal number if sites we have. I can be completely wrong.