Hello I am using Docker agent to run flows one of the task i

Question

Hello I am using Docker agent to run flows one of the task inside the flow needs to interact with k8s cluster which requires KUBECONFIG currently I am making this available with ` volume` flag not sure if I am doing it correctly here what is the best practice

Kevin Kho · Answer

I think <https github com PrefectHQ prefect issues 5000|this> link will help you with that

Anna Geller · Answer

plus if you just need to trigger a KubernetesJob you can use one of Kubernetes tasks from the task library here is an example you could use <https github com anna geller packaging prefect flows tree master flows task library>

Kevin Kho · Answer

Or maybe <https github com PrefectHQ prefect issues 4386 issuecomment 914340488|this>

Prasanth Kothuri · Answer

this is how I am starting the agent

Prasanth Kothuri · Answer

```nohup prefect agent docker start api <http localhost 4200> env KUBECONFIG= root vk9 config env S3 ENDPOINT=ZZZ env S3 ACCESS KEY=XXX env S3 SECRET KEY=YYY volume root root show flow logs no pull 2 gt amp 1 gt tmp prefect docker agent log amp ```

Prasanth Kothuri · Answer

flows are able to see the KUBECONFIG and able to create pods wondering if this is the best way to do this

Kevin Kho · Answer

I think it s fine I think other ways would require a refactor and I am not seeing anything wrong here

Prasanth Kothuri · Answer

thanks < Kevin Kho> one of the step task in the flow is to run spark submit on k8s cluster for this I am using `ShellTask` to do spark submit which absolutely works fine however would like to know other ways people are doing this