Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hi I am passing Dockerfile as an argument in docker run , where I mention to copy all my helper files in current directory, but when i run the flow it says , unable to import the file

<@U02K1D993CP>

1. Can you explain what you mean by docker run? Do you mean that you use Docker storage and you run “prefect register”?
2. Can you share the output of “prefect diagnostics”?
3. What agent do you use?
4. Can you share your definition of storage and run configuration?
5. Can you share your Dockerfile and how you build the image?

Im using docker storage, ecs run,ecs agent, im simply passing dockerfile in the docker storage

Image from iOS.jpg

<@U02K1D993CP> Sure :slightly_smiling_face:

in general, I believe it’s better to install your custom modules within the Dockerfile rather than relying on PYTHONPATH, because it’s much more reliable. This <https://medium.com/the-prefect-blog/the-simple-guide-to-productionizing-data-workflows-with-docker-31a5aae67c0a|blog post> explains how to do it.

Additionally, this repo provides an example of a Dockerfile incl. <https://github.com/anna-geller/packaging-prefect-flows/blob/master/commands.bash|commands to build it and push to ECR> and how it can be used e.g. <https://github.com/anna-geller/packaging-prefect-flows/blob/master/flows/s3_ecs_run_custom_ecr_image.py|with ECSRun>.