Hey! We want to use Prefect with k8s in a way that would automatically connect to k8s API and will create Pods according to our real-time requirements. can this be done with Prefect?

Hey @Avi A, Have you checked out the Kubernetes tasks in the API library? There may be a useful first-class task for your use case, however we may need more information on what you’re trying to accomplish. Check it out here: https://docs.prefect.io/api/latest/tasks/kubernetes.html#createnamespacedpod

looks cool, I’ll check it out! I also encountered this warning here, and I’m not sure which features it applies to… https://docs.prefect.io/orchestration/tutorial/k8s.html#scaling-out-with-kubernetes

Currently using Prefect Cloud is the only way to utilize agents, like the Kubernetes Agent with token access mentioned on that page, as Prefect Core is limited to a local Prefect Server. You can still interact with the K8s API in a task though.

thanks, we’ll take a look. are there plans to open source these parts?

Not at the moment, currently the team has been laser-focused on PIN-16 and task library integrations with tools like Great Expectations.