Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Where are the docs for using a docker image for flow storage?

can you give more details? I have been working on deploying my flow with docker and may be able to help

So far I'm reading this <https://www.prefect.io/guide/blog/prefect-2-3-0-adds-support-for-flows-defined-in-docker-images-and-github/|release note>

I want to build a docker image that contains both the flow code and dependencies. Ideally I would push the image to amazon ECR, and the flow-run (running in ECS) would use the provided image to run.

The flow will run some pyspark code, so I intend to use an image that has pyspark installed.

It looks like an `ecs-task` infrastructure block could be used, but not sure how to pass in the (docker) `image_tag`

thats pretty much what I am working on as well, just havent gotten to the ECS step. I had started using infra blocks but the new project thing released like 2 weeks ago pretty well

<https://docs.prefect.io/latest/concepts/projects/>

it essentially makes a file to build the docker image, asks where its stored and pushes it to wherever you want it to run (ECS)

Screenshot 2023-04-24 at 4.00.40 PM.png

here is what my main prefect yaml file looks like for the build and pull... again dont have the push yet