JC Garcia
11/11/2020, 6:46 PMenvironment = KubernetesJobEnvironment(job_spec_file=f"{local_dir_path}/job_spec.yaml")
...
with Flow("k8s-example-flow", storage=storage, environment=environment) as flow:
...
flow.register(project_name="Test Project")
However when the job is scheduled via the UI, the k8s job spec does not match the one I generated and filled in the job_spec_file
. I understand that some properties will be overwritten, but no env vars or resource requests/limits are coming through. Any pointers?josh
11/11/2020, 7:34 PMprefect-job
that is responsible for pulling your flow’s environment and then creating the Kubernetes job that you set as the flow’s environment. Are you running into an issue with the initial prefect-job
?
This is actually something we are phasing out with the addition of the new RunConfig pattern (docs aren’t fully written yet and it’s still experimental). referenceJC Garcia
11/11/2020, 8:10 PMjob_spec_file
but it does not use itjosh
11/11/2020, 8:11 PMJC Garcia
11/11/2020, 8:12 PMjosh
11/11/2020, 8:15 PMJC Garcia
11/11/2020, 8:16 PMjob_spec_file
josh
11/11/2020, 8:17 PMJC Garcia
11/11/2020, 8:17 PM