https://prefect.io logo
Title
d

David

07/20/2022, 11:35 AM
Hello, I am trying to use the vertex agent unfortunately I keep getting
400 List of found errors:	1.Field: job_spec.worker_pool_specs[0].container_spec.env[12].value; Message: Required field is not set.	2.Field: job_spec.worker_pool_specs[0].container_spec.env[3].value; Message: Required field is not set.	3.Field: job_spec.worker_pool_specs[0].container_spec.env[4].value; Message: Required field is not set.	 [field_violations {
  field: "job_spec.worker_pool_specs[0].container_spec.env[12].value"
  description: "Required field is not set."
}
field_violations {
  field: "job_spec.worker_pool_specs[0].container_spec.env[3].value"
  description: "Required field is not set."
}
field_violations {
  field: "job_spec.worker_pool_specs[0].container_spec.env[4].value"
  description: "Required field is not set."
}
]
1
a

Anna Geller

07/20/2022, 12:58 PM
Are you using Prefect Server? I saw a similar issue there
here it looked like it worked in Cloud but not on Server - can you replicate the same behavior and if this is indeed an actual issue, open a GitHub bug report in the server repo?
moving your other message to clean up the main thread please next time post everything in the thread to keep the main channel clean, thanks in advance "my run config is as followed:
run_config = VertexRun(
    labels=["vertex"],
    image="python:3.10.5-bullseye",
    machine_type="e2-standard-2",
)
and agent is executed like
prefect agent vertex start --region-name europe-west4 --project <redacted> --label vertex
"
d

David

07/20/2022, 2:13 PM
hi, yes seems to be a similar problem
it's is a very interesting feature to be able to run serverless pipelines on gcp vertex
but the documentation is scarce, and the logging is very unclear as in what environment variables are causing a problem.
i applied the worker_pool_spec from the other thread but problem remains
a

Anna Geller

07/20/2022, 2:23 PM
I'll add it to our content backlog to explore serverless execution for Vertex for Prefect 2.0 meanwhile, if you can confirm that it works for you using the free version of Prefect Cloud and it works for you, you can either use Cloud for now, or submit an issue in the server repo