Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Heya!

_[Moved here from <#C048ZHT5U3U|>]_

I'm struggling to find resources / reference for _scheduling run container_ tasks with Prefect.

The prefect docs on <https://docs.prefect.io/tutorials/docker/|Running flows with Docker> does not really fit my case as it relies on python code present, but in my case all I need it to do is run a pre-build image.

Currently I have _cron entry_ to do this
```0 * * * * docker compose -f /some/path/docker-compose.yml run --rm my_service my_command```
the _docker-compose.yml_
```version: '3.8'
services:

  my_service:
    build: app/.
    env_file:
      - app/.env
    logging:
      driver: journald```
_*How can I tell prefect to create a deployment to*_
• run a container with a pre-defined image (I want to build it separately.. the docker-compose currently takes care of that)
• load .env file into the container's envs
• run specified `my_cmd` (entry-point's args)
All I really need is some sort of reference material of building such deployment :shrug:

I could do this with a _Shell block_, but then I need to install docker insider of the agent container to run a shell task, that runs container in docker :smile:

Sounds awful.. I'm hoping I can do this more natively with e.g. Docker Container Block.

Does this help?
<https://prefecthq.github.io/prefect-docker/#pull-image-and-create-start-log-stop-and-remove-docker-container>

Indeed!

I had taken a look at this just about earlier and it sort of does what I'm looking for.. I'll tinker with this and see, if I can make it do what docker-compose does for us right now :smile:

Unfortunately, there is something broken with `prefect_docker` lib or I'm mis-using it..

The problem is that the library is sort of useless as it does not wait until the container ("task") completes or exits on it's own..  More info in <https://github.com/PrefectHQ/prefect-docker/issues/33|How do we wait for container to exit on its own? #33>

Also Their example does not do what it is trying to convey at all, for example the `command="echo 'hello world!' &amp;&amp; sleep 60"` will simply output
```21:37:54.109 | INFO    | Flow run 'glorious-jerboa' - hello world! &amp;&amp; sleep 60```
and not print "Hello World!" in the logs and then sleep for 60 seconds.. :shrug:

--

How do you guys run "containers" as prefect tasks? Seems like it should be trivial thing to do for an orchestration tool and I'm at loss.. :disappointed:

I suspect that this lib is intended for whole different purpose than I'm trying to use it for.. i.e. Starting / Stopping docker containers.. that's it.

What I'm looking for is for prefect to run a "container job" as part of a task as in, if you'd run a shell script, but encapsulated in a docker image.

Maybe you’re looking for this?
<https://orion-docs.prefect.io/tutorials/docker/?h=docker>

&gt;  Also Their example does not do what it is trying to convey at all, for example the `command="echo 'hello world!' &amp;&amp; sleep 60"` will simply output
```21:37:54.109 | INFO    | Flow run 'glorious-jerboa' - hello world! &amp;&amp; sleep 60```
other than not sleeping properly, it did echo “hello world” as a log statement. to get both of the commands working properly, you can put dump it into a shell script like and run `bash test.sh`

Solved! Here is the issue in case anyone is looking for an example <https://github.com/PrefectHQ/prefect-docker/issues/33#issuecomment-1426994799>

Thank you very much to everyone involved :blue_heart: