https://prefect.io
Join Slack
Hey guys, I build modules with tasks that I'm using in my flow, but updating flow version these modu...
# ask-community
d
Hey guys, I build modules with tasks that I'm using in my flow, but updating flow version these modules aren't updated. What are the best practices?
k
Hi @Diogo Munaro! What storage are you using and what behavior do you see?
d
I'm using local FS... When I submit a new version of the flow it only updates the main flow and not their modules. If my flow is only one file everything works great
k
Are you running the agent on local also?
d
no... it's docker agent
k
Ah the issue is that local storage only stores the flow, but not the dependencies. You probably need to create a Docker container and put the dependencies there so that they get packaged together and passed to the agent that way.
Are you using LocalRun or DockerRun?
d
DockerRun
but dependencies are the rest of the project... I build a main file with the flow and other files with tasks (modules)
Can't I package everything and send?
k
Yep I understand what you’re saying. You package them through the Docker container and pass that to 
DockerRun
for the 
docker agent
to pick up.
I think this page will give a lot more information.
❤️ 1
Specifically the Dependency Requirements option.
❤️ 1
d
thanks!
k
No problem!
I have a small project where I made a Python package for the dependencies and placed them into a container (I recommend using pip instead of conda for the Docker installation)
d
I found my problem... I'm using 
idempotency_key=flow.serialized_hash()
that ignoring new version if main flow don't change... Thank you a lot!!
👍 1
k
I see. Glad you solved it
Open in Slack
PreviousNext
Powered by

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Powered by