Shubham
10/07/2025, 5:22 AMMarvin
10/07/2025, 5:22 AMMarvin
10/07/2025, 5:27 AMShubham
10/07/2025, 5:28 AMShubham
10/07/2025, 5:29 AMMarvin
10/07/2025, 5:29 AMMarvin
10/07/2025, 5:31 AMprefect work-pool ls
- Try creating another pool (example: Kubernetes):
prefect work-pool create "my-k8s-pool" --type kubernetes
- Or Docker:
prefect work-pool create "my-docker-pool" --type docker
If that creation fails due to plan restrictions (unexpected on Starter), let me know the error and I’ll help sort it out.Shubham
10/07/2025, 11:55 AMShubham
10/07/2025, 11:56 AMMarvin
10/07/2025, 11:56 AMMarvin
10/07/2025, 11:57 AMprefect work-pool ls
prefect work-pool create "extra-pool" --type docker
If you’re at the limit, you’ll get an error indicating the plan restriction.
Tips if you’re limited to 1 custom pool:
- Use multiple queues within that pool to segment environments/SLAs and set concurrency per queue.
- Route deployments to specific queues for isolation.
If you share the link you saw, I’ll confirm the wording and update guidance here.Shubham
10/07/2025, 2:53 PMMarvin
10/07/2025, 2:53 PMMarvin
10/07/2025, 2:55 PMprefect work-queue create dev --pool my-custom-pool
prefect work-queue create prod --pool my-custom-pool
- Set queue-specific concurrency:
prefect work-queue set-concurrency-limit prod 10
- Use the pool’s base job template + deployment-level overrides to vary infra per deployment:
- Kubernetes: override namespace, image, resources, env vars per deployment
- Docker: override image, command, env vars per deployment
- ECS/Cloud Run/ACI: override task/CPU/memory, subnets/security groups, etc.
- Route deployments to queues instead of creating more pools; queues + concurrency + priorities give you most of the isolation you’d want early on.
If you truly need multiple custom pool types (e.g., Docker and Kubernetes side-by-side) and the 1 custom pool cap is constraining, upgrading to the Team plan lifts those quotas.
Helpful background:
- Work pools overview: Prefect 3.x Work Pools
- Work pools and workers (how pools/queues map to infra): Work pools and workers
- Serverless overview: Introducing Prefect Serverless
If you share your target setup (e.g., “Kubernetes prod + Docker sandbox”), I can suggest a concrete queue + deployment override layout to make it work within Starter.