Hello, I have a question about deploying prefect on Kubernetes. I deployed orion and an agent, it works.
• Is it possible to deploy flow runs as kubernetes jobs without orion and without an agent, by doing everything locally (agent+orion locally) ? Or the only solution is what I did (agent+orion on the cluster)
• Is it possible to launch one k8s job per task in a flow ? or the workflow is only entirely executed on one pod ? It seems task runner isn't the same thing as the "infrastructure".
01/20/2023, 5:17 PM
1. Yes. This series of posts shows how.
2. The task runner is set on the flow. You could turn each task into a flow, make a deployment for each of those flows with K8s specified for the infrastructure, and then use run_deployment to create a flow run for each deployment.