https://prefect.io logo
Title
j

Joshua Greenhalgh

04/22/2022, 12:50 PM
Is there a way to specify a default job template for kubernetes agent in the manifests? So I am looking at https://docs.prefect.io/orchestration/agents/kubernetes.html#custom-job-template - and I tried to use the
--job-template
on the
prefect agent kubernetes install
command in the hope that this would work but in fact it does not - do I need to modify the containers args which are
prefect agent kubernetes start
to use the flag?
Well that didn't work 😞 got;
Unsupported file scheme <gs://blah/template.yml>
When the agent tried to start the flow...
I suppose I should do this in the application code then as opposed to at a default level on the agent?
k

Kevin Kho

04/22/2022, 1:39 PM
Oh can you try
gcs
for the scheme? Reading this code
Then it’s worth a PR to catch the
gs
scheme too
j

Joshua Greenhalgh

04/22/2022, 1:49 PM
Ahhh is
gcs
an alternitive? Never knew!!
k

Kevin Kho

04/22/2022, 1:50 PM
I dont know if that is or if it’s just Prefect parsing for it
a

Anna Geller

04/22/2022, 1:53 PM
based on this, seems like gs:// is more of a standard than gcs:// but it seems there are no strong conventions imposed by GCP
if you would make a PR Kevin, we would probably need to allow both to avoid breaking changes
j

Joshua Greenhalgh

04/22/2022, 1:55 PM
I would suggest that given when you copy the URI from the gcloud ui (or ls with gsutil) you get
gs://
that should probably be what is used? But of course as you say it may break for people so 🤷 - it works as expected with
gcs://
so thanks!
Also this;
data_infra git:(create-k8s-secret-sa-key-for-dbt-bq-user) ✗ gsutil ls <gcs://prefect_job_templates>
InvalidUrlError: Unrecognized scheme "gcs".
k

Kevin Kho

04/22/2022, 1:57 PM
Yeah I’ll just add an
or
there today
👍 1
PR to follow
💯 1
🙌 1