What is the best way to tell Kubernetes Agent to utilise only the nodes from a specific Node pool? We are running the agent on AKS in a separate namespace.
j
josh
11/20/2020, 4:03 PM
Hi @Klemen Strojan if you use something like the Kubernetes Agent’s
job_template_path
kwarg you can optionally provide a different default template for the jobs that the agent creates. If you follow a spec like the current default one you could copy it and add in your nodeSelector. Then provide the agent with the path to that updated yaml spec.
Side note you could avoid this entirely if you want to test out a new experimental feature 🙂 There is a new feature called Run Configs which is a replacement for the current Environment pattern. With this you could set a KubernetesRun for your flow’s
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.