Rasmus Lindqvist
04/21/2022, 5:48 AMprefect agent vertex start
? Or would you recommend deploying Prefect on in another way on GCP instead?Anna Geller
prefect agent vertex start --label yourlabel
more details:
• https://docs.prefect.io/orchestration/agents/vertex.html#requirements
• https://docs.prefect.io/orchestration/flow_config/run_configs.html#vertexrunRasmus Lindqvist
04/21/2022, 12:30 PMprefect agent vertex start
does not start an agent on Vertex but rather starts an agent where the command is run from?
In that case, a small GCE or Cloud run should be enough for hosting the actual VertexAgent that will then spin up Vertex machines for the flow runs?Anna Geller
Rasmus Lindqvist
04/21/2022, 1:01 PMAnna Geller
Rasmus Lindqvist
04/22/2022, 11:57 AMModuleNotFoundError("No module named 'src'
, as mentioned in several previous slack threads and on discourse.
I understand this is because storage pulls only the flow file. The ideal case for us would be to only redeploy the Docker image when updating dependencies and pull the src code from Github, much like they are doing in the tutorial that you linked earlier; only rebuild the docker image when the dependencies change, and not the src code.
I understood that we could package our src code and install into the image. But is there a way around having to rebuild the docker image and rather mount the src code when deploy flow runs?Anna Geller
Rasmus Lindqvist
04/22/2022, 1:58 PMAnna Geller