Daniel Davee
05/20/2021, 4:08 PMimage: prefecthq/prefect:latest
on to GKE, can prefect be ran on GKEKevin Kho
05/20/2021, 4:11 PMDaniel Davee
05/20/2021, 4:13 PMKevin Kho
05/20/2021, 4:14 PMDaniel Davee
05/20/2021, 4:15 PMTyler Wanner
05/20/2021, 4:22 PMDaniel Davee
05/20/2021, 4:52 PMTyler Wanner
05/20/2021, 4:58 PMDaniel Davee
05/20/2021, 4:59 PMTyler Wanner
05/20/2021, 5:15 PMKevin Kho
05/20/2021, 5:16 PMprefecthq/prefect:0.14.17
. This will be updated in the next versionDaniel Davee
05/20/2021, 5:25 PMKevin Kho
05/20/2021, 5:58 PMEXTRA_PIP_PACKAGES
Daniel Davee
05/20/2021, 5:59 PMKevin Kho
05/20/2021, 6:00 PMDaniel Davee
05/20/2021, 6:01 PMKevin Kho
05/20/2021, 6:03 PMKubernetesRun
configuration attached to your flow and pass an image this way. Docs .executor=DaskExecutor(
cluster_class="dask_kubernetes.KubeCluster",
cluster_kwargs={
"pod_template": make_pod_spec(
image="prefecthq/prefect:latest",
labels={
"flow": flow_name
},
memory_limit=None,
memory_request=None,
)
},
adapt_kwargs={"maximum": 10}
)
Daniel Davee
05/20/2021, 6:20 PMKevin Kho
05/20/2021, 6:23 PMDaniel Davee
05/20/2021, 6:25 PMKevin Kho
05/20/2021, 6:26 PMDaniel Davee
05/20/2021, 6:28 PMKevin Kho
05/20/2021, 6:33 PMDaniel Davee
05/20/2021, 6:36 PMKevin Kho
05/20/2021, 6:40 PM