Marco Ruta
11/22/2024, 2:52 PMMarvin
11/22/2024, 2:52 PMvalues.yaml
file for each worker to customize the deployment. Each values.yaml
can have different names and configurations, but make sure the worker names are unique. This file contains settings that connect the worker to the proper account, workspace, and work pool in Prefect Cloud.
4. Deploy Using Helm: Use the Helm install command with your specified values.yaml
file for each worker deployment:
shell
helm install worker-name1 prefect/prefect-helm -f values1.yaml
helm install worker-name2 prefect/prefect-helm -f values2.yaml
5. Verify Deployment: After deployment, you can verify each worker by checking the pods in your Kubernetes namespace.
Refer to the following documentation for detailed instructions and options:
- Prefect 2.x Kubernetes Deployment Guide
- Prefect 3.x Kubernetes Infrastructure Guide
Deploying multiple workers is straightforward and a good way to manage different workloads or environments. Just like how we all need extra hands around the office—if only Marvin had some!Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by