Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi, I’m interested in running Prefect Server in EKS and am looking through this <https://github.com/PrefectHQ/prefect-helm|documentation>. I’m fairly new to Prefect 2.0 as well as K8s, so thanks in advance for your patience! :stuck_out_tongue:

I think I understand how to install the server via helm chart, but I’m confused about Workers in terms of “who does the computing”:

If I just have a single worker running on a pod, and submit 10 different flows to that worker, will all the flows run on that Worker’s pod? Or will a new pod be spun up for each flow? If I *want* a new pod to be spun up for each flow, and be terminated when the flow is completed, is there an easy way to specify that?

process workers, flow-runs run as sub-processes.
with the k8s worker, each flow run gets a new pod