Hi, I'm back at <https://prefect-community.slack.com/archives/CL09KU1K7/p1615401726121200?thread_ts=...

haf

04/06/2021, 1:07 PM

Hi, I'm back at https://prefect-community.slack.com/archives/CL09KU1K7/p1615401726121200?thread_ts=1615327031.065400&cid=CL09KU1K7 trying to make it work; has job templating (being able to add a single annotation) started working?

haf

04/06/2021, 1:20 PM

Is there a way to supply a job template that works now?

haf

04/06/2021, 1:20 PM

Ref docs https://docs.prefect.io/orchestration/agents/kubernetes.html#running-in-cluster

haf

04/06/2021, 2:04 PM

I created this bug report https://github.com/PrefectHQ/prefect/issues/4359

Kevin Kho

04/06/2021, 2:19 PM

Hey @haf, I will look into this when I get the chance and probably respond to you on the Github issue.

🙌 1

haf

04/06/2021, 2:20 PM

Thanks @Kevin Kho

Tyler Wanner

04/06/2021, 5:20 PM

Hi @haf. I've provided an update in your bug ticket. Please look into it and let me know if I'm understanding properly

👍 1

haf

04/06/2021, 5:25 PM

@Tyler Wanner That is good progress towards a repro. I have this issue as we speak but I’m doing some exercise before I get back tonight.

haf

04/06/2021, 5:25 PM

I’ll improve the issue then with some findings.

haf

04/06/2021, 5:25 PM

Thank you for looking into it.

Tyler Wanner

04/06/2021, 5:26 PM

sure thing--i'll actually add the things i used in my attempt at repro--i can tell you that i had multiple issues getting it working, it was not a great experience and I'll definitely be looking to proper it up

haf

04/06/2021, 5:26 PM

Yeah I never got it working before. Maybe I will now :)

🚀 1

Tyler Wanner

04/06/2021, 5:27 PM

do let me know

Tyler Wanner

04/06/2021, 5:43 PM

also, i noticed you mounted to

/usr/local/lib/python3.8/site-packages/prefect/agent/kubernetes/job_template.yaml

that's the install location for python3.8 but in the prefect image, by default it runs 3.7. if you mount it to

/usr/local/lib/python3.7/site-packages/prefect/agent/kubernetes/job_template.yaml

then you don't have to actually change the args at all (this is equivalent to overwriting the default file which, as you said, works)

haf

04/19/2021, 4:57 PM

I solved it (in a rather hacky way!)

Tyler Wanner

04/19/2021, 10:21 PM

glad to hear it! responded in the issue because probably you won’t be the only person to try to do something like this, and it’s more searchable there. I’ll try to think on how the experience can be improved but generally your run config is going to be the better place to set those annotations and args

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.