Anatoly Myachev
03/21/2022, 8:33 PMEXTRA_PIP_PACKAGES environment variable supposed to work with KubernetesFlowRunner?Kevin Kho
envKevin Kho
Kevin Kho
KubernetesFlowRunner(env={"EXTRA_PIP_PACKAGES": "my-extra-package1 my-extra-package2"})Anatoly Myachev
03/21/2022, 8:47 PMKubernetesFlowRunner(image="prefecthq/prefect:2.0b2-python3.8", env={"EXTRA_PIP_PACKAGES": "pandas"}) . Could this behavior be caused by redefining the entrypoint in Kubernetes Job manifest somewhere in Prefect?Kevin Kho
Anna Geller
EXTRA_PIP_PACKAGES works with KubernetesFlowRunner. I'm sure it works with DockerFlowRunner though.Anatoly Myachev
03/21/2022, 8:51 PMKevin Kho
Anatoly Myachev
03/21/2022, 8:52 PMkubectl describe pods ... :
Containers:
job:
Container ID: <docker://563d2687bfc19688248cb5e6d7f6bd053f7a09d181b066be50d5dd021aac79d>5
Image: prefecthq/prefect:2.0b2-python3.8
Image ID: <docker-pullable://prefecthq/prefect@sha256:6c7e1cab30ed20a10c557e8c2f832582326b4d00fda53d3cd1e70073dc535b65>
Port: <none>
Host Port: <none>
Command:
python
-m
prefect.engine
f52ed613-33a4-4b28-a8c8-2f8f2b222a00
State: Terminated
Reason: Completed
Exit Code: 0
Started: Mon, 21 Mar 2022 20:12:05 +0000
Finished: Mon, 21 Mar 2022 20:12:07 +0000
Ready: False
Restart Count: 0
Environment:
EXTRA_PIP_PACKAGES: pandas
PREFECT_API_URL: <http://orion:4200/api>
Mounts:
/var/run/secrets/kubernetes.io/serviceaccount from kube-api-access-cwmkj (ro)Anatoly Myachev
03/21/2022, 8:53 PMDockerFlowRunner case :)Kevin Kho
Anatoly Myachev
03/21/2022, 8:55 PMAnna Geller
KubernetesFlowRunner - EXTRA_PIP_PACKAGES doesn't work. So far you can only use EXTRA_PIP_PACKAGES with the DockerFlowRunner it seems. Let me open an issue to check if we can add it to KubernetesFlowRunner as well.
@Marvin open "Orion: allow to install EXTRA_PIP_PACKAGES at runtime using KubernetesFlowRunner"Marvin
03/21/2022, 9:41 PM