Hello, I am trying to understand the concept of every part of Prefect, but raised these question I was not able to Google:
• What is the difference/relationship between
Work pool
and
Work queue
?
• What is the difference/relationship between
Worker
and
Agent
?
Thanks
a
alex
04/25/2023, 1:58 PM
Hey @Patrik Fejda! A work pool can contain one or many work queues of different priorities. Workers and agents are very similar. They both poll work pools for flow runs to execute, but workers are scoped to a single type of infrastructure (e.g., Kubernetes, Docker, etc.). This page in the docs dives deeper into the responsibility of these concepts: https://docs.prefect.io/latest/concepts/work-pools/
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.