Hi, I’m interested in running Prefect Server in EKS and am looking through this documentation. I’m fairly new to Prefect 2.0 as well as K8s, so thanks in advance for your patience! 😛
I think I understand how to install the server via helm chart, but I’m confused about Workers in terms of “who does the computing”:
If I just have a single worker running on a pod, and submit 10 different flows to that worker, will all the flows run on that Worker’s pod? Or will a new pod be spun up for each flow? If I want a new pod to be spun up for each flow, and be terminated when the flow is completed, is there an easy way to specify that?
c
Christopher Boyd
09/11/2023, 7:06 PM
each flow run gets a new pod
Christopher Boyd
09/11/2023, 7:07 PM
process workers, flow-runs run as sub-processes.
with the k8s worker, each flow run gets a new pod
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.