You guys should put up some more documentation regarding the vertex agent. It is absolutely a fantastic way to run pipelines. Am currently running the vertex agent in a GKE autopilot cluster. The vertex ai pipelines really allows you to scale endlessly while at the same time massively reducing costs.