Ankit
02/08/2023, 4:10 PMTimo Vink
02/08/2023, 4:13 PMAnkit
02/08/2023, 4:14 PMTimo Vink
02/08/2023, 4:18 PMnodeSelector
on your jobs (kubernetes feature, not a prefect feature) to make sure it uses the right instance type.
You do do this by using the customizations
parameters of the KubernetesJob
object. You can probably do this on the command-line, but much easier if you create your Deployment
using the Python API.
Example by Anna here:
https://github.com/anna-geller/prefect-deployment-patterns/blob/main/blocks/infrastructure_blocks/kubernetes-job/customizations/gpu_on_gke.pyAnkit
02/08/2023, 4:20 PMTimo Vink
02/08/2023, 4:20 PMnodeSelector
should be depends on the details of your cluster/environment. But if you look at your existing nodes you can probably find a prepopulated label that has the instance type on itAnkit
02/08/2023, 4:21 PM