I'm running prefect server in k8s so I have pods for all prefects pieces, pods for the k8s agents and then those pods are making pods for the flows. How do I control configuration of the flow pods? I would like to annotate them to grant IAM permissions. Do they get whatever the k8s agent has? Can I pass something from the agent to the flow pods?

Hi @Lon Nix, all of what you are describing seems to be configurable by using KubernetesRun run configuration. KubernetesAgent deploys flows as Kubernetes jobs and by using KubernetesRun you can configure a service account to use for each flow as needed. When you say IAM, I assume you mean AWS, right? 🙂 if so, AWS has some docs showing how to set up IAM roles for service accounts.

gotcha. thanks. Is service account the only thing? We're not quite to the IAM roles for SA setup yet, we use kube2iam and annotations control access. could I use the

job_template

field to specify the yaml to use for the job?

And when it comes to passing something from the agent to the flow pods, it’s possible to pass certain things like environment variables when you start the agent - those should be available in flow pods as well:

prefect agent <AGENT TYPE> start --env KEY=VALUE

awesome, thanks!