Alex Bussan
11/18/2020, 4:29 PMflow.run_config = KubernetesRun(
job_template_path="my_custom_template.yaml"
)
vs configuring/running a flow this way (using KubernetesJobEnvironment)
flow = Flow(
"flow_w_jobenv",
environment=KubernetesJobEnvironment(job_spec_file="job_spec.yaml"),
storage=Docker()
)
I'm struggling to understand the differences/ tradoffs of configuring a job one way vs another. Both ways you can pass in information that a job spec would need. Then you register the flow and run it and the k8s agent picks it up. Is there any fundamental difference I'm missing?Jim Crist-Harif
11/18/2020, 4:30 PMAlex Bussan
11/18/2020, 4:31 PM