Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
m
Matt Allen
09/02/2020, 7:02 PMHas anyone had any luck running the build and register step for their flows in a gitlab CI runner? I'm having trouble with the docker storage being unable to find the docker API when running in gitlab
c
Chris White
09/02/2020, 7:05 PMHi Matt, when building / registering from CircleCI, the following Docker config was useful for me:
import docker
default_client = docker.from_env()
storage = Docker(
base_url=default_client.api.base_url,
tls_config=docker.TLSConfig(default_client.api.cert),
...,
)m
Matt Allen
09/02/2020, 7:07 PMI'll give that a shot, thanks
👍 1
Did you need any extra options in your gitlabci.yaml file as well?
c
Chris White
09/02/2020, 7:08 PMThis was in GitHub actually
m
Matt Allen
09/02/2020, 7:09 PMAh gotcha
c
Chris White
09/02/2020, 7:09 PMbut no additional config necessary in GitHub or Circle FWIW
👍 1
m
Matt Allen
09/02/2020, 8:15 PMDo you know if there's a way to pass in private registry credentials to the Docker storage object?
c
Chris White
09/02/2020, 8:24 PMYou can’t pass them in via the Python API, but the
dockerm
Matt Allen
09/02/2020, 8:27 PMAh, I see. Thanks
👍 1
a
Andy Dyer
10/01/2020, 3:30 PM@Matt Allen @Chris White do you have any more insight into this. Trying to do docker in docker to register a flow on gitlab ci and even with these changes still getting issues
File "/usr/local/lib/python3.8/site-packages/docker/transport/unixconn.py", line 43, in connect
sock.connect(self.unix_socket)
urllib3.exceptions.ProtocolError: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))m
Matt Allen
10/01/2020, 3:32 PMDo you have this variable in your gitlabci file?
DOCKER_HOST: <tcp://docker:2376>Along with
services:
- docker:19.03.12-dinda
Andy Dyer
10/01/2020, 3:34 PMi have the dind but not that var. Ill try it thanks
new issue, this is my first docker in docker so I appreciate the help
raise DockerException(
docker.errors.DockerException: Error while fetching server API version: HTTPConnectionPool(host='docker', port=2376): Max retries exceeded with url: /version (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fc4c4bafee0>: Failed to establish a new connection: [Errno 111] Connection refused'))m
Matt Allen
10/01/2020, 3:45 PMAre you running docker login before you run your register flow script?
I actually switched away from using the docker storage because of speed issues, so I'm trying to remember my debugging steps
a
Andy Dyer
10/01/2020, 3:46 PMright so im not using docker storage. I am using GCP container registry
its probably that i just need to gcloud auth first isnt it? a connection refused error is so opaque
m
Matt Allen
10/01/2020, 3:54 PMAh yeah that could be it. If you're not using docker storage I don't think you'd need docker in docker at all actually
a
Andy Dyer
10/01/2020, 4:15 PMyeah everything is authenticated still getting the same error. Certainly you need docker in docker right? because i am in a docker container (gitlab ci) building the docker storage for a flow to register and send off to gcr.
m
Matt Allen
10/01/2020, 4:36 PMOh I was confused when you said you weren't using docker storage, nevermind
The error you are getting still looks like it can't connect to the docker daemon, which happens before it tries to authenticate with gcp container registry