Hi there, did anyone get a Docker infrastructure with a private Docker registry in 2.3.0 to work? I defined a "Docker Registry" and a "Docker Container" block and used the Docker Container block as infrastructure block in the deployment.

prefect deployment build myflow.py:myflow \
--path /prefect/flows/myflow \
-ib docker-container/dev-image \
--name local_docker \
--skip-upload \
--apply

After running the deployment it breaks with "no basic auth credentials". Inspecting the "Docker Container" block shows that it should use the defined registry block. Double checked the credentials multiple times and successfully logged in with

docker login...

I tried the same on 2.2.0 with the same error after executing the deployment :-(

Are you asking for a private DockerHub registry?

No, selfhosted registry within our network. But this shouldn't make any difference because we can specify the url , right?

for public images, you could set it on the infra block without using

DockerRegistry

block:

prefect deployment build flows/healthcheck.py:healthcheck \
-n dockerhub -q prod --infra docker-container \
--override image=annaprefect/dataflowops:latest \
--apply

you're correct that for private registries setting auth there and setting URL to repo/image:tag should work if not, this deserves a GitHub issue with MRE (Minimal Reproducible Example)

Ok. I will open a issue with MRE

just saw that I can have 1 private image on Dockerhub so I should be able to reproduce soon

No, I didn't opened one. Waited for your feedback

ok, let me create it then and I will link here and you can add more info

Great, thanks

@Anna Geller what about doing this with an ECSTask? For example, in Prefect 1.0 ECSRun config:

containerDefinitions = [
        dict(
                name = "flow",
                image = "<http://ghcr.io/chicago-joe/intelli-options:latest|ghcr.io/chicago-joe/intelli-options:latest>",
                repositoryCredentials = dict(
                        credentialsParameter = "arn:aws:secretsmanager:us-east-2:xxxxxx:secret:GHCR_PRIVATE_REGISTRY_AUTH-xxxxx")
        )
],

Joe, the issue is resolved now ✅

sweet! I'll give it a try

Hi- could you point me to docs describing how to configure a docker agent to pull from a private registry with 1.x?

not sure who you ask now but you need:

docker login -u username -p pwd

before starting the agent

@Anna Geller can you provide an example of using repositoryCredentials / credentialsParamater in a prefect 2 ecs-task block? I'm still getting a 401 Unauthorized from the above, it is quite frustrating 😕

ECSTask block uses IAM roles to authenticate with ECR registry