https://prefect.io
Join Slack
Hello Everyone! I use `local agent` and try to bind local folder with folder inside docker container...
# ask-community
r
Hello Everyone! I use 
local agent
and try to bind local folder with folder inside docker container using 
volumes
, but looks like it doesn’t work or I do it wrong 👀:
Copy code
container_name = StringFormatter(name="Container name", template="scenario_{scenario_id}_task_{task_id}")
container_id = create_container(image_name=image_name,
                                container_name=container_name(scenario_id=scenario_id, task_id=task_id),
                                # command=command,
                                command=['ls'],
                                volumes=['data:/home/data',
                                         'temp:/home/temp'],
                                ).set_upstream(input_file_path)
started = start_container(container_id=container_id)
status_code = wait_on_container(container_id=container_id, upstream_tasks=[started])
logs = get_container_logs(container_id=container_id, upstream_tasks=[status_code])
log([logs])
The 
log([logs])
shows, that the 
data
and 
temp
folders are missed. What am I missing here?
k
Hey @Ruslan Aliev, I think this will help you. That is for Docker agent but I think the code snippet there might work
👍 1
I think you need to pass a host_config as well to the Prefect task
r
@Kevin Kho I tried to pass 
host_config
to 
prefect.tasks.docker.containers.CreateContainer
, but on run got that error: 
TypeError: __init__() got an unexpected keyword argument 'NetworkMode'
But your code snippet works fine - thank you! I don’t know why 
host_config
didn’t work correctly with Prefect 
CreateContainer
.
k
Ah that might be Prefect version? What is your version?
Could you also share with me your task call?
r
@Kevin Kho Hi! Sorry for delay. System apps: 
docker -v
Docker version 20.10.8, build 3967b7d
Python packages: 
prefect.__version__ = '0.15.5'
docker.__version__ = '5.0.0'
Flow code: https://gist.github.com/RuslanTau/b184386aad252d1a46a7bc3f98c3f36f
k
I think the problem here is that the Prefect task for 
CreateContiner
takes in a 
dict
for host_config. You actually created a host_config and passed it. That Prefect task will take care of handling it. Can you try:
Copy code
host_config = {"binds": absolute_volumes}
r
@Kevin Kho 
host_config = {"binds": absolute_volumes}
works fine - thank you! It took me a while to figure out why you hand over the key “binds” instead “Binds”, which I get by 
create_host_config
 method 🙃
👍 1
k
Nice!
2 Views
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by