Hey Prefect community .... Does anyone knows if .... is there any way to rename the k8s prefect jobs...

Marcelo Santoro

12/20/2022, 3:13 PM

Hey Prefect community .... Does anyone knows if .... is there any way to rename the k8s prefect jobs ? because is really hard to identify what flow is running in each job 😕

👀 1

✅ 1

Bianca Hoch

12/21/2022, 6:49 PM

Hi Marcelo, I believe you can modify the names of the k8s jobs by passing the name of the flow to the

name

variable in the base job template. Here a few resources to get your started: • Creating and Deploying a custom Kubernetes Infrastructure Block • Documentation for KubernetesJob (see

name

attribute) • Additional documentation for KubernetesJob

Bianca Hoch

12/21/2022, 6:54 PM

When creating a custom infrastructure block, it may look something like this with the

name

set to your "prefect-flow-name".

Copy code

from prefect.infrastructure import KubernetesJob

k8s_job=KubernetesJob(
    namespace="prefect2",
    name = "prefect-flow-name"
    image="prefecthq/prefect:2.3.0-python3.9",
    env={"EXTRA_PIP_PACKAGES": "adlfs"}
  job=KubernetesJob.job_from_file("modified_run_job.yaml")
)

k8s_job.save("k8sdev")

Marcelo Santoro

12/21/2022, 6:55 PM

Thank you so much @Bianca Hoch... I will give it a try 🙏

Marcelo Santoro

12/21/2022, 6:55 PM

cc: @Josh 🙂

Marcelo Santoro

12/21/2022, 7:45 PM

@Bianca Hoch I have a question, does this work in prefect 1 ?

Bianca Hoch

12/21/2022, 7:54 PM

Oh! For 1.0 that would be KubernetesRun I believe (which replaced KubernetesJobEnvironment). From what I understand, you can still modify the name that is specified for the job by changing it in the job template. Here's some more resources for you that should be helpful: • https://docs-v1.prefect.io/api/latest/run_configs.html#kubernetesrun

🙌 1

Marcelo Santoro

12/21/2022, 7:55 PM

Thank you very much 🙂

Bianca Hoch

12/21/2022, 7:56 PM

And just for fun, here's an article that compares and contrasts how KubernetesRun and KubernetesJob compare. This will be useful for you when you begin to consider migrating to 2.0.

🙌 1

✅ 1

👍 1

4 Views

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.