Is there a way to use

nvidia-docker

with the prefect docker agent?

Hi @Vincent! The docker agent is responsible for pulling a docker container and running it. You should need to specify the image in the

RunConfig

of the flow. You may want to check this

Hi - Thanks for the response. My question is more specifically about enabling a Docker agent to run GPU configured images. Most of the time on a local setting I will use

nvidia-docker run -it <image>

which grants access to the use the host GPUs. However is seems that when the docker agent runs a container, the default docker client does not enable utilization of the GPU

Oh I see….let me look into thi smore

There are two parts to it. One is starting with a compatible docker image (ie. the nvidia base image) and the second is to have the nvidia runtime in the the host execute the docker image.

Ah ok I see what you mean. Will look

no - my docker agent is running on the host machine.

Ok I asked the team and we currently don’t have a configuration for the agent exposed to a different docker client. The best bet might be to configure the

base_url

for the docker client like this , but other than that this is not something we’ve dealt with yet unfortunately.

thanks