Channels
#prefect-server
Title
p
Prasanth Kothuri
11/09/2021, 6:30 PMHello all, I am using prefect docker agent, for the flow run containers I need to expose some ports, how can I do this ? e.g
-p 12001:12001k
Kevin Kho
11/09/2021, 6:50 PM
Hey @Prasanth Kothuri, looking into this
I guess that would be the best bet. Since the Docker syntax is like:
Copy code
client.api.create_host_config(port_bindings={
12001:12001
}) Copy code
DockerRun(...,host_config={"port_bindings" = {12001:12001}})p
Prasanth Kothuri
11/09/2021, 6:59 PM👍
@Kevin Kho I am doing the following
Copy code
# flow run time configuration
f.run_config = DockerRun(
labels=["dt4dev_osdataproc"],
image="<http://gitlab-registry.internal.sanger.ac.uk/pam-dt4/spark-service/spark-service-docker/spark-app:v0.3|gitlab-registry.internal.sanger.ac.uk/pam-dt4/spark-service/spark-service-docker/spark-app:v0.3>",
host_config={"port_bindings":{12001:12001}},
env={"rpc_port": "12001","bm_port": "12101"}
) Copy code
root@dt4-prefect:~/prefect# docker ps
CONTAINER ID IMAGE COMMAND CREATED STATUS PORTS NAMES
079f58a79463 <http://gitlab-registry.internal.sanger.ac.uk/pam-dt4/spark-service/spark-service-docker/spark-app:v0.3|gitlab-registry.internal.sanger.ac.uk/pam-dt4/spark-service/spark-service-docker/spark-app:v0.3> "/usr/bin/entrypoint…" 10 seconds ago Up 9 seconds pearl-tigerk
Kevin Kho
11/10/2021, 4:51 PM
Ok I’m not confident this is exposed now. The example here says it can be done without supplying the ports though. (check under port bindings). But in Prefect, the
ports Copy code
client.api.create_container(
'busybox', 'ls', ports=[1111, 2222],
host_config=client.api.create_host_config(port_bindings={
1111: 4567,
2222: None
})
)I’ll open an issue for this
p
Prasanth Kothuri
11/10/2021, 5:27 PMok, thank you, let me see if I use host networking in the meantime like this
host_config={"network_mode":"host"},k
Kevin Kho
11/10/2021, 5:29 PM
I guess that would yeah
3 Views