<@ULVA73B9P> what is the underlying infrastructure...
# ask-marvin
c
@Marvin what is the underlying infrastructure that supports workpools (that workpools are hosted on) for prefect 3 in a self-hosted setup using cloud run v2?
m
In a self-hosted setup using Prefect 3 and Google Cloud Run V2, the work pools are designed to efficiently manage and distribute Prefect flows across different environments and infrastructures. Here's a brief overview based on the Prefect 3 documentation: 1. Work Pools Concept: Work pools are a mechanism in Prefect that help coordinate deployments with workers through a known channel, much like pub/sub systems. They allow users to manage the distribution and execution of flow runs and are optimized for different use cases. By switching a deployment's work pool, users can change the worker executing their runs easily, facilitating task management and debugging (source). 2. Google Cloud Run Usage: Google Cloud Run provides the underlying infrastructure in a serverless manner. It automatically manages the scaling and availability of your flow run infrastructure, allowing you to focus on code development and deployment. It's highly scalable, integrating seamlessly with other Google Cloud services, and supports deploying containerized applications without managing the underlying infrastructure directly (source). This combination supports high scalability and flexibility, allowing you to develop and deploy flows efficiently without needing to worry about the underlying infrastructure.
n
work pools are just logical containers for job config that we store in the database, kinda like a pub sub topic like marvin mentions there is not extra supporting infra, they're just things in the db that store a job template that deployments / flow runs can override workers are the things that need supporting infra, e.g. your computer when you run
prefect worker start
or any other place you run that command
thank you 1