Matviy Unzhakov
08/28/2024, 8:20 PMMarvin
08/28/2024, 8:21 PMnamespace
field in the job configuration section.
Here is an example configuration snippet for the values.yaml
file:
worker:
job:
namespace: "your-namespace"
Replace "your-namespace"
with your desired namespace.
For more detailed configurations and examples, you can refer to the Prefect Kubernetes (Worker) documentation:
https://docs.prefect.io/latest/integrations/prefect-kubernetes/worker/
Additionally, more details on deploying with Helm can be found here:
https://docs.prefect.io/latest/guides/deployment/kubernetes/
If you encounter any issues, searching through Prefect's GitHub repository can provide additional context and examples:
https://github.com/PrefectHQ/prefect/issues
I hope this helps in configuring your Prefect deployment on EKS!Matviy Unzhakov
08/28/2024, 9:04 PMMarvin
08/28/2024, 9:04 PMvalues.yaml
file. This template will specify the job configuration and use placeholders to reference values.
2. Include Job Configuration in Helm Values:
Add the base job template in the Helm values.yaml
file, specifying the namespace or any other configurations.
Example `values.yaml`:
worker:
jobTemplate:
apiVersion: batch/v1
kind: Job
metadata:
namespace: "{{ default .Values.worker.namespace 'default' }}"
labels:
app: prefect-job
spec:
template:
spec:
containers:
- name: prefect-job
image: "{{ .Values.worker.image }}"
env: "{{ .Values.worker.env }}"
args: "{{ .Values.worker.command }}"
resources:
requests:
memory: "{{ .Values.worker.memoryRequest }}"
cpu: "{{ .Values.worker.cpuRequest }}"
imagePullPolicy: "{{ .Values.worker.imagePullPolicy }}"
restartPolicy: Never
namespace: "your-namespace"
image: "prefecthq/prefect:latest"
env: []
command: []
memoryRequest: "256Mi"
cpuRequest: "500m"
imagePullPolicy: "IfNotPresent"
In the above configuration:
- The namespace
field in the job template is set to a dynamic value using placeholders.
- The namespace
variable is defined in the values file as "your-namespace"
.
For further customization and detailed steps, refer to the Prefect Work Pools documentation and the Kubernetes Worker documentation.
Hope this helps streamline your deployment configuration!Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by