Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
d
David
07/20/2022, 11:35 AMHello, I am trying to use the vertex agent unfortunately I keep getting
400 List of found errors: 1.Field: job_spec.worker_pool_specs[0].container_spec.env[12].value; Message: Required field is not set. 2.Field: job_spec.worker_pool_specs[0].container_spec.env[3].value; Message: Required field is not set. 3.Field: job_spec.worker_pool_specs[0].container_spec.env[4].value; Message: Required field is not set. [field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[12].value"
description: "Required field is not set."
}
field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[3].value"
description: "Required field is not set."
}
field_violations {
field: "job_spec.worker_pool_specs[0].container_spec.env[4].value"
description: "Required field is not set."
}
]✅ 1
a
Anna Geller
07/20/2022, 12:58 PMAre you using Prefect Server? I saw a similar issue there
here it looked like it worked in Cloud but not on Server - can you replicate the same behavior and if this is indeed an actual issue, open a GitHub bug report in the server repo?
moving your other message to clean up the main thread
please next time post everything in the thread to keep the main channel clean, thanks in advance
"my run config is as followed:
run_config = VertexRun(
labels=["vertex"],
image="python:3.10.5-bullseye",
machine_type="e2-standard-2",
)prefect agent vertex start --region-name europe-west4 --project <redacted> --label vertexd
David
07/20/2022, 2:13 PMhi, yes seems to be a similar problem
it's is a very interesting feature to be able to run serverless pipelines on gcp vertex
but the documentation is scarce, and the logging is very unclear as in what environment variables are causing a problem.
i applied the worker_pool_spec from the other thread but problem remains
a
Anna Geller
07/20/2022, 2:23 PMI'll add it to our content backlog to explore serverless execution for Vertex for Prefect 2.0
meanwhile, if you can confirm that it works for you using the free version of Prefect Cloud and it works for you, you can either use Cloud for now, or submit an issue in the server repo