Thanks @Jeff Hale! Im actually kinda new to Prefect, and we want to use it to auto scale with the large number of jobs were planning to orchestrate. Im currently using Prefect locally and just running 2 agents in 1 work pool. Im assuming the local process agent wont be autoscaled... Is there like a good place you can point me to to get set up with Kubernetes?
j
Jeff Hale
03/15/2024, 9:04 PM
Yep. Sure thing. Here’s the Kubernetes guide.
And here are docs on hosting you might find helpful.
I’d definitely switch from agents to workers if you’re making the move to K8s. Here’s an upgrade guide.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.