FDE
08/14/2025, 3:37 PMMarvin
08/14/2025, 3:37 PMMarvin
08/14/2025, 3:39 PMprefect worker start -p my-baremetal-pool --limit 4
- The work pool’s concurrency limit caps total concurrency across all workers in that pool. Effective concurrency = min(pool limit, sum of worker limits).
- You’d only need multiple workers if you want isolation (different environments), different queues, or to spread load across hosts. Not required for simple local parallelism.
If you’re on a single box and just want multiple flows at once: 1 pool + 1 worker with --limit > 1
will do the job—assuming your machine can keep up.FDE
08/14/2025, 3:42 PMFDE
08/14/2025, 3:44 PMMarvin
08/14/2025, 3:44 PMMarvin
08/14/2025, 3:45 PMprefect worker start -p my-pool --limit 4
Pool-level concurrency is unlimited unless you set it, so the effective cap is:
- per‑worker: --limit
(default 1)
- per‑pool: pool concurrency limit (default unlimited)
- actual concurrency = min(pool limit, sum of worker limits, your machine’s patience)Nate
08/14/2025, 3:45 PMNate
08/14/2025, 3:46 PMNate
08/14/2025, 3:47 PMNate
08/14/2025, 3:48 PMNate
08/14/2025, 3:50 PMFDE
08/14/2025, 3:56 PMNate
08/14/2025, 4:36 PMNate
08/14/2025, 4:37 PM.serve
tasks that call other flows etc