I added a temp worker to pool due to high demand. how can I check if this new worker is actually help or if any tasks are going into this new worker?
both workers are on two different systems.
k
Kevin Grismore
08/28/2025, 6:13 PM
scheduled flow runs aren't automatically load balanced between workers in the same pool - workers check periodically for scheduled runs, and by default, will collect and submit all of them for execution. this makes which worker submits which runs purely a matter of timing.
I'm assuming in this case you're using process workers, so the individual worker is tied intrinsically to the hardware your flows are running on. In this case, I'd create different work queues, have your workers consume from those queues separately, then place different deployments on different queues
v
Victor
08/28/2025, 6:22 PM
are scheduled flow runs automatically balanced on work queues?
I have task waiting on pending because main worker has 20 concurrency but the pending tasks wont go to new worker I added? will it work if instead of additional worker, I add it as another queue under same pool?
k
Kevin Grismore
08/28/2025, 6:24 PM
are scheduled flow runs automatically balanced on work queues?
no. if all your runs are coming from the same deployment, limiting the max concurrency on the worker would be the way to distribute them
v
Victor
08/28/2025, 6:28 PM
but then there is no way to see what happening in workers, its like black box. I will try figuring out best way to scale or add capacity during surge timings. thank you for help.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.