Hello, I am trying to use the vertex agent unfortu...
# prefect-communityd
David
07/20/2022, 11:35 AMHello, I am trying to use the vertex agent unfortunately I keep getting
Copy code
400 List of found errors: 1.Field: job_spec.worker_pool_specs[0].container_spec.env[12].value; Message: Required field is not set. 2.Field: job_spec.worker_pool_specs[0].container_spec.env[3].value; Message: Required field is not set. 3.Field: job_spec.worker_pool_specs[0].container_spec.env[4].value; Message: Required field is not set. [field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[12].value"
description: "Required field is not set."
}
field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[3].value"
description: "Required field is not set."
}
field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[4].value"
description: "Required field is not set."
}
]✅ 1
a
Anna Geller
07/20/2022, 12:58 PM
Are you using Prefect Server? I saw a similar issue there
Anna Geller
07/20/2022, 1:01 PM
here it looked like it worked in Cloud but not on Server - can you replicate the same behavior and if this is indeed an actual issue, open a GitHub bug report in the server repo?
Anna Geller
07/20/2022, 1:02 PM
moving your other message to clean up the main thread
please next time post everything in the thread to keep the main channel clean, thanks in advance
"my run config is as followed:
Copy code
run_config = VertexRun(
labels=["vertex"],
image="python:3.10.5-bullseye",
machine_type="e2-standard-2",
) Copy code
prefect agent vertex start --region-name europe-west4 --project <redacted> --label vertexd
David
07/20/2022, 2:13 PMhi, yes seems to be a similar problem
David
07/20/2022, 2:14 PMit's is a very interesting feature to be able to run serverless pipelines on gcp vertex
David
07/20/2022, 2:15 PMbut the documentation is scarce, and the logging is very unclear as in what environment variables are causing a problem.
David
07/20/2022, 2:16 PMi applied the worker_pool_spec from the other thread but problem remains
a
Anna Geller
07/20/2022, 2:23 PM
I'll add it to our content backlog to explore serverless execution for Vertex for Prefect 2.0
meanwhile, if you can confirm that it works for you using the free version of Prefect Cloud and it works for you, you can either use Cloud for now, or submit an issue in the server repo
5 Views