Hi Everyone, How can i implement round robin on prefect
For example let suppose i have 3 queue (q1, q2, q3) in the worker-pool with same priority and concurrency 1, is there a way it can pick one from q1 then from q2 and then from q3.
b
Bianca Hoch
02/27/2024, 2:39 PM
Hey Nimesh, qq before I give any suggestions, why 3 queues? are the 3 queues being polled by 3 separate workers?
n
Nimesh Kumar
02/27/2024, 2:42 PM
3 is just a random number i took.
Please allow me to explain my usecase
Let say We have two sites, A and B, from which inference requests are being made. Site A has 1000 inference requests, while site B has 10. Currently, the 10 requests from site B are queued behind the 1000 requests from site A, causing unnecessary delays.
What I aim to achieve is to enable these 10 requests from site B to proceed independently of the requests from site A, without having to wait for all 1000 requests to complete.
So i was thinking like the number of queues need to be equal number if sites we have. I can be completely wrong.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.