https://prefect.io logo
Channels
Powered by
a

Andy Dyer

10/01/2020, 5:34 PM
Hey all we are just about to finish our first prefect flow and have enjoyed the dev experience. I am trying to register my flow in gitlabs CI and push its Docker storage to google container registry, but I am getting two errors I assume revolving around Docker in Docker issues. Please see below
Copy code
With DOCKER_HOST = <tcp://docker:2376>

    raise DockerException(
docker.errors.DockerException: Error while fetching server API version: HTTPConnectionPool(host='docker', port=2376): Max retries exceeded with url: /version (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7fb67baf4760>: Failed to establish a new connection: [Errno 111] Connection refused'))


without DOCKER_HOST set 

docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))
n

nicholas

10/01/2020, 7:12 PM
Hi @Andy Dyer - when you say register your flow in gitlabs CI, what do you mean? Register it with Prefect Cloud/Server in a gitlab CI pipeline? Is that when the docker image push step is failing?
a

Andy Dyer

10/01/2020, 7:15 PM
Register it with Prefect Cloud/Server in a gitlab CI pipeline? Is that when the docker image push step is failing?
yeah we are using a cloud backend and the registration works locally. I dont think its a prefect issue. Probably more of a connection to the docker daemon running in gitlab ci
ci script looks like
Copy code
pip3 install -r requirements.txt;
      printf "%s" "$SERVICE_KEY_JSON" > "keyfile.json";
      gcloud auth activate-service-account --key-file keyfile.json;
      prefect backend cloud;
      prefect auth login --token $PREFECT_TENANT_TOKEN;
      python3 main.py;
n

nicholas

10/01/2020, 7:18 PM
Yeah that sounds correct, it seems like there's a daemon connection problem external to Prefect. Is there a way to ensure your CI machine has an accessible docker daemon of a recent version maybe?
a

Andy Dyer

10/01/2020, 7:20 PM
kind of a DevOps noob can you give me some info on how to find that out?
like the CI machine itself is running a gcloud docker image that is running the above script
n

nicholas

10/01/2020, 7:26 PM
Ah ok, then it sounds like the issue is that the container you're running (gcloud in this case) probably doesn't have docker installed. Try installing docker in your CI script ahead of time with whatever commands make sense for that image. You can find the installation instructions in the docker docs here: https://docs.docker.com/engine/install/
a

Andy Dyer

10/01/2020, 7:32 PM
so it does have docker installed because 
which docker
does point to 
/usr/local/bin/docker
n

nicholas

10/01/2020, 7:33 PM
Can you access the docker daemon from within the container?
a

Andy Dyer

10/01/2020, 7:34 PM
like just 
ps aux | grep dockerd
?
n

nicholas

10/01/2020, 7:37 PM
Perhaps just 
dockerd
a

Andy Dyer

10/01/2020, 7:39 PM
/bin/bash: line 120: dockerd: command not found
do you have an image in mind that would have it preinstalled. I can just switch to installing the gcloud cli probably faster as a whole
n

nicholas

10/01/2020, 7:40 PM
Yeah that's what I'd suggest, that's usually easiest. I don't have one in mind though, that'll be specific more to your pipeline
a

Andy Dyer

10/01/2020, 7:41 PM
does the prefect image have it preinstalled?
n

nicholas

10/01/2020, 7:45 PM
it does!
a

Andy Dyer

10/01/2020, 8:13 PM
so I have the prefect image, installed gcloud and am authed but still
Copy code
requests.exceptions.ConnectionError: HTTPConnectionPool(host='docker', port=2376): Max retries exceeded with url: /version (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f724125ae80>: Failed to establish a new connection: [Errno 111] Connection refused'))
Copy code
docker.errors.DockerException: Error while fetching server API version: HTTPConnectionPool(host='docker', port=2376): Max retries exceeded with url: /version (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f724125ae80>: Failed to establish a new connection: [Errno 111] Connection refused'))
n

nicholas

10/01/2020, 8:16 PM
What's the value of 
$DOCKER_HOST
in your machine's environment?
a

Andy Dyer

10/01/2020, 8:19 PM
DOCKER_HOST=<tcp://docker:2376>
2 Views
Powered by