James Brady
08/14/2022, 1:40 PMdask_kubernetes.KubeCluster
class ā trying to get a flow to run on a GPU-enabled node. What's happening:
⢠The pod_template I'm using for the flow specifies <http://nvidia.com/gpu|nvidia.com/gpu>: 1
, per the docs
⢠karpenter starts a new node, which has a GPU (š)
⢠However, the new node can't accommodate the dask client because it doesn't have the right resource annotation ("0/3 nodes are available: ⦠, 3 Insufficient nvidia.com/gpu")
I realise this might be a question better-suited to the dask community, but would appreciate any stories of people successfully running Prefect 2 workloads on GPU-accelerated nodes and/or help figuring out the above specific issue.Anna Geller
08/14/2022, 2:45 PMJames Brady
08/15/2022, 3:56 PM