Also how much memory and CPU will I need to run a prefect ag

Question

Also how much memory and CPU will I need to run a prefect agent given that I ll be running kubernetes jobs as separate pods

Clint M · Answer

cpu won t be much but I have an agent running my cluster right now that takes 80Mb

James Phoenix · Answer

Cool have you got an example yml file I can use without the ENV variables please

James Phoenix · Answer

I m using GKE auto pilot

Clint M · Answer

well I m doing some undocumented things I run the agent and code together as part of a k8s deployment so I m hacking the prefect deployment yaml not k8s deployment yaml to have a pod local directory and then just spawning the work in a sub process not a k8s job

Nate · Answer

< James Phoenix> the agent process itself is very light I don t believe you ll need to worry about its resource usage too much however the memory CPU usage of your flow runs spawned by the agent on your pods will depend on the nature of those flow runs you can

James Phoenix · Answer

Cool slightly smiling face < Nate> can you please provide a default k8s agent yml that I can test

James Phoenix · Answer

Or specify what is wrong with mine

Christopher Boyd · Answer

Hi James couple things

Christopher Boyd · Answer

1 would you mind clearing up your posts and condensing them to a single thread so we aren t cluttering up the channel for everyone

Christopher Boyd · Answer

2 you can get create a generic prefect deployment manifest using `prefect kubernetes manifest orion`

Christopher Boyd · Answer

We have some resources to do this from the agent as well as helm charts <https discourse prefect io t deploying prefect agents on kubernetes 1298>

Christopher Boyd · Answer

James Phoenix · Answer

I ve cleaned up my threads Thanks < Christopher Boyd>

James Phoenix · Answer

Really good videos thanks < Christopher Boyd> 2x questions please

James Phoenix · Answer

Do I still need to have an orion API container if I m pointing to prefect cloud How can I create a queue for my k8s agent Or do I simply need to create a `kubernetes` queue and then do the same in <https app prefect cloud >

Christopher Boyd · Answer

Yes although it s lightweight but it s executing and returning on behalf of the agent even to the cloud

Christopher Boyd · Answer

For the second you only need to do it one place

Christopher Boyd · Answer

So if you are authenticated via cli you can do prefect work queue create

Christopher Boyd · Answer

It will be pushed to cloud and you can configure your agent to listen on that work queue afterwards

Christopher Boyd · Answer

Alternatively you can start it in the command itself used to instantiate the agent