Hi! Are there any examples of tasks that run in a Docker container, and capture its stdout?

Hey @Manuel Aristarán are you referring to a task which executes a Docker container like https://docs.prefect.io/core/task_library/docker.html#containers or do you mean having the tasks of your flow all run inside a Docker container?

A single task which executes a container. I also need to attach volumes when creating a container, which

CreateContainer

does not seem to support

We always welcome contributions to the task library! As of right now I am not aware of any examples which do this but you could mimic the source code for the

CreateContainer

task https://github.com/PrefectHQ/prefect/blob/master/src/prefect/tasks/docker/containers.py#L8 and adjust it to fit your needs 🙂

awesome, I might contribute support for the

volumes=

kwarg 🙂

Awesome! It uses Docker’s Python client https://docker-py.readthedocs.io/en/stable/api.html#docker.api.container.ContainerApiMixin.create_container

yup

Also another good suggestion! Quick Q: do you find the granularity of the Docker tasks to be good or cumbersome? For example it takes multiple tasks to create a container, start it, get the logs, and stop it. Whereas this could be accomplished in a single task.

i’ll report back when I finish writing this flow 🙂 At first sight, yeah, it might be better —for one-off commands— to also have a

Task

that does everything