Docker doesn't play well with academic clusters because of the root-privilege requirements, but has anyone used Prefect with Singularity? It's an alternative to Docker but can still pull from Docker Hub images. Prefect storage and agent types for Singularity would be really helpful in academic HPC use cases.
w
Wilson Bilkovich
08/19/2021, 2:58 PM
Have you looked at Podman? I’m about to attempt running a Prefect cluster using it, hopefully it ‘just works’.
j
Jack Sundberg
08/19/2021, 3:01 PM
I have not, but it looks super simple. Are you trying to use it with Prefect's Docker classes? (and just use a command alias "*alias docker=podman"*)
w
Wilson Bilkovich
08/19/2021, 4:34 PM
I guess my specific plan is to arrange to use podman instead of docker for the Kubernetes cluster that I run Prefect + Dask on.