https://prefect.io
Join Slack
Hi, has anyone experienced the following error that the Kubernetes Jobs cannot pull an public image....
# ask-community
p
Hi, has anyone experienced the following error that the Kubernetes Jobs cannot pull an public image. It gives the following error: Inserted in the thread.
✅ 1
Copy code
Failed to pull image "nginx": rpc error: code = Unknown desc = failed to pull and unpack image "<http://docker.io/library/nginx:latest|docker.io/library/nginx:latest>": failed to resolve reference "<http://docker.io/library/nginx:latest|docker.io/library/nginx:latest>": failed to do request: Head "<https://registry-1.docker.io/v2/library/nginx/manifests/latest>": dial tcp: lookup <http://registry-1.docker.io|registry-1.docker.io> on [::1]:53: read udp [::1]:38431->[::1]:53: read: connection refused
Is it possible for the kubernetes cluster to fetch the image locally?
c
Hi Parwez, this seems like a network / dns issue with your cluster
read connection refused [:1]53 seems like perhaps an ipv6 network connection that’s failing a dns lookup
You could try to curl docker.io just from some shell in one of your pods to confirm
regarding fetching your image locally , you can setup your own container / image repository - I believe every cloud has their own version, or you can host one internally if you’re using on-prem
What image tag are you using in your deployment file for your kubernetes jobs ?
p
Hi @Christopher Boyd, Thanks a lot for the answer! I'm able to curl docker.io and google.com. I have solved it by setting the image pull policy to 'Never' to make it pull the image locally. This works for now, but will not when I try to setup CI/CD. I'm using Azure but I'm having issues with adding the container registry to the subnet. Do you have any guidelines or recommendations? 🙌
c
https://docs.microsoft.com/en-us/azure/container-registry/container-registry-get-started-azure-cli - I’d just set up your container registry in the same resource group if you have control over it
if your image pull policy is never, it’s not “pulling” the image, it’s just using your local cache?
p
Yes, I'm able to move into the same resource group as the Kubernetes Service! I'm currently moving it. Thanks Christopher! 🙌 Ahh! makes much better sense, because I don't have locally currently, but it still fetches the image.
👋 1
Now I get this issue _____<http://.azurecr.io/v2/prefect2/manifests/latest|.>azurecr.io/v2/prefect2/manifests/latest": dial tcp: lookup acraros.azurecr.io on [:1]53: read udp [:1]45437->[:1]53: read: connection refused. Does it maybe takes some time before it works?
I have also done this: By default, the allow trusted services setting is enabled in a new Azure container registry. To disable or re-enable the setting in the portal: 1. In the portal, navigate to your container registry. 2. Under Settings, select Networking. 3. In Allow public network access, select Selected networks or Disabled. 4. Do one of the following: ◦ To disable access by trusted services, under Firewall exception, uncheck Allow trusted Microsoft services to access this container registry. ◦ To allow trusted services, under Firewall exception, check Allow trusted Microsoft services to access this container registry. 5. Select Save.
@Christopher Boyd just wanted to mentioned that it has been resolved. Once again thank you for your help!! 🙌
🙌 1
c
Great to hear Parwez, happy coding!
8 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by