Kelvin
07/28/2022, 6:21 PMAnna Geller
07/28/2022, 6:27 PMKelvin
07/28/2022, 6:42 PMBilly McMonagle
07/28/2022, 6:59 PMKhuyen Tran
07/28/2022, 7:35 PMdeployment.yaml
. You can see what you can specify in the file hereAnna Geller
07/28/2022, 7:39 PMBilly McMonagle
07/28/2022, 7:57 PMKelvin
07/29/2022, 1:46 AMDeploymentSpec(
flow_location="myflow.py",
name="dailyrun",
schedule=CronSchedule(
cron="0 0 * * *",
timezone="America/New_York"),
flow_runner=SubprocessFlowRunner(condaenv="specialenv01"),
)
infrastructure: Union[DockerContainer, KubernetesJob, Process] = Field(
default_factory=Process
)
Process is defined at: https://github.com/PrefectHQ/prefect/blob/20c5f74442e982d5933bfec2f91aa5e14a980f2f/src/prefect/infrastructure/process.py#L29
"env" only specifies environment variables so not helpful in my case
However, it seems that Process runs the command "python" in the yaml - so if I substitute:
command:
- python
- -m
- prefect.engine
with
command:
- /my/path/to/miniconda3/envs/specialenv01/bin/python
- -m
- prefect.engine
and deploy a job and run it, it seems to work nowKhuyen Tran
07/29/2022, 5:08 PMdeployment.yaml
file in the docs soon. But for now the easiest way is to use the UIMatt from DataHouse
07/29/2022, 6:44 PM