Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

Hey guys, I build modules with tasks that I'm using in my flow, but updating flow version these modules aren't updated. What are the best practices?

Hi <@U01G41J0H50>! What storage are you using and what behavior do you see?

I'm using local FS... When I submit a new version of the flow it only updates the main flow and not their modules. If my flow is only one file everything works great

Ah the issue is that local storage only stores the flow,  but not the dependencies. You probably need to create a Docker container and put the dependencies there so that they get packaged together and passed to the agent that way.

but dependencies are the rest of the project... I build a main file with the flow and other files with tasks (modules)

Yep I understand what you’re saying. You package them through the Docker container and pass that to `DockerRun` for the `docker agent` to pick up.

I think this <https://docs.prefect.io/orchestration/flow_config/docker.html#managing-docker-images|page> will give a lot more information.

Specifically the <https://docs.prefect.io/orchestration/flow_config/docker.html#dependency-requirements|Dependency Requirements> option.

I have a small <https://github.com/kvnkho/demos/tree/main/prefect/docker_with_local_storage|project> where I made a Python package for the dependencies and placed them into a container (I recommend using pip instead of conda for the Docker installation)

I found my problem... I'm using `idempotency_key=flow.serialized_hash()` that ignoring new version if main flow don't change... Thank you a lot!!