Prasanth Kothuri
10/29/2021, 5:03 PM--volume
flag, not sure if I am doing it correctly here, what is the best practice ?Kevin Kho
10/29/2021, 5:05 PMAnna Geller
10/29/2021, 5:07 PMKevin Kho
10/29/2021, 5:08 PMPrasanth Kothuri
10/29/2021, 5:13 PMnohup prefect agent docker start --api <http://localhost:4200> --env KUBECONFIG=/root/vk9.config --env S3_ENDPOINT=ZZZ --env S3_ACCESS_KEY=XXX --env S3_SECRET_KEY=YYY --volume /root:/root --show-flow-logs --no-pull 2>&1 > /tmp/prefect.docker.agent.log &
Kevin Kho
10/29/2021, 5:23 PMPrasanth Kothuri
10/29/2021, 5:30 PMShellTask
to do spark-submit, which absolutely works fine ! however would like to know other ways people are doing this