```prefect agent docker start```
results in
```req...
# ask-communityp
Philip MacMenamin
11/04/2021, 5:31 PM Copy code
prefect agent docker start Copy code
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7ff5ba1a23a0>: Failed to establish a new connection: [Errno 111] Connection refused'))k
Kevin Kho
11/04/2021, 5:32 PM
This is on server right? Did you spin up your server and can you access the UI?
p
Philip MacMenamin
11/04/2021, 5:33 PM Copy code
$ uname -a
Linux L02147210 5.4.0-89-generic #100-Ubuntu SMP Fri Sep 24 14:50:10 UTC 2021 x86_64 x86_64 x86_64 GNU/LinuxPhilip MacMenamin
11/04/2021, 5:33 PM Copy code
$ prefect diagnostics
{
"config_overrides": {
"PREFECT__CONTEXT__SECRETS__AWS_CREDENTIALS": true,
"PREFECT__FLOWS__CHECKPOINTING": true
},
"env_vars": [],
"system_information": {
"platform": "Linux-5.4.0-89-generic-x86_64-with-glibc2.29",
"prefect_backend": "server",
"prefect_version": "0.15.7",
"python_version": "3.8.10"
}
}Philip MacMenamin
11/04/2021, 5:33 PM@Kevin Kho - this is on localhost
k
Kevin Kho
11/04/2021, 5:35 PM
Are all of your images healthy? Does accessing the UI of server work (localhost:8080)0?
p
Philip MacMenamin
11/04/2021, 5:36 PMso the server has to run to start the agent?
Philip MacMenamin
11/04/2021, 5:36 PMah, ok. It does. I was trying to follow: https://github.com/kvnkho/demos/tree/main/prefect/docker_with_local_storage
k
Kevin Kho
11/04/2021, 5:37 PM
Yes you need the server up and running because an agent polls a backend (Cloud or Server) every 10 seconds to pick up flows. So the agent is establishing a connection to server.
Kevin Kho
11/04/2021, 5:38 PM
I know you are on Server for security reasons right? But Cloud would be easier to test with non-sensitive data as you get the 20000 task runs for free every month
p
Philip MacMenamin
11/04/2021, 5:40 PMhow are you defining Server and Cloud?
Philip MacMenamin
11/04/2021, 5:41 PMas in, run on your infra, which you call Cloud?
Philip MacMenamin
11/04/2021, 5:41 PMor my infra which is called Server?
a
Anna Geller
11/04/2021, 5:41 PM
k
Kevin Kho
11/04/2021, 5:41 PM
Yeah exactly so Cloud is our managed offering of Server. Both are called backends.
p
Philip MacMenamin
11/04/2021, 5:44 PMI guess... the issue is I'd like to be able to just run flows locally without all that much hassle. ATM I just want to see if I can get a containerized flow up
a
Anna Geller
11/04/2021, 5:50 PM
In that case you should definitely go for Cloud. It’s hassle free - you sign up, create an API key, authenticate your terminal with this key (
prefect auth login --key YOUR_KEYp
Philip MacMenamin
11/04/2021, 5:51 PMbasically I'd like an example to run https://docs.prefect.io/api/latest/tasks/docker.html
Philip MacMenamin
11/04/2021, 5:52 PMas in, a flow that has say one task that's a containerized task.
Philip MacMenamin
11/04/2021, 5:53 PMfor example, i have a docker image A that does something I want, how do I roll that into a flow?
Philip MacMenamin
11/04/2021, 5:53 PMI could presumably use a shelltask, and call into it, but I assumed seeing as there were dockertasks this would be more helpful.
Philip MacMenamin
11/04/2021, 5:54 PMunless this sounds wrong headed.
k
Kevin Kho
11/04/2021, 5:55 PM
Yeah you can try it out with Cloud and Cloud will orchestrate the spinning up of the container on your local and running the Flow there.
I think there are two things here. One is you want to run a container that contains tasks, which you can do just by supplying the image to run on. This will be preferable if the code is Python because you get more granular observability.
The second is the CreateContainer task you can use. This doc kinda shows what that looks like (ignore the Kubernetes portion)
Kevin Kho
11/04/2021, 5:55 PM
The Docker agent will launch your Flow as a container. No need to create a container if it’s just Python code.
p
Philip MacMenamin
11/04/2021, 5:56 PMok - thanks guys. I'll give this a look.
👍 1
12 Views