hi @Anna Geller@Kevin Kho, how does one decide how many Docker Agent to run? How many concurrent flow task can a Docker Agent handle?
a
Anna Geller
12/08/2021, 10:22 AM
@Christopher Chong Tau Teng A single agent can manage many concurrent flow runs - the only reason to have multiple active agents is if you need to support flow runs on different deployment platforms e.g. Docker agent and a Kubernetes agent.
c
Christopher Chong Tau Teng
12/08/2021, 10:24 AM
@Anna Geller noted, practically is there a maximum no of concurrent flow task for 1 docker agent?
a
Anna Geller
12/08/2021, 10:29 AM
There are no concurrency limits for an agent since agent is a lightweight process that only polls for new flow runs and deploys them to separate processes/containers, so it really doesn’t do much work on its own other than polling and offloading work that some other processes execute
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.