Hey all, I'm using Prefect cloud and running flows with Kubernetes (in a GKE cluster). I've been seeing issues with OOM errors in my flows and want to specify resource requests for my pods. I tried adding
memory: "x"
to the job_variables in my yaml file for this deployment and I see that variable on the configuration page for the deployment, but my actual pods do not specify resource requirements in their yaml. Anyone have experience with this or know what i'm doing wrong?
Brian Oldak
01/24/2025, 5:03 PM
Was able to get this to work by adding these as variables to the base job template
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
