So I'm looking at creating multiple flows with som...
# ask-community
w
So I'm looking at creating multiple flows with some shared configuration and utilities. I'm going to use the docker storage for this, but I'm curious how others have structured their repositories where there are many different flows. Do you keep a flat directory of flow files (with no external dependencies or shared code) and use S3 / git storage? Or do you build a separate docker storage for each flow in CI / build a single storage and include all the flows (as described here); if you do this what does your project structure look like? I'm looking to run the flow build and registration steps in CI; I'm assuming this is a common approach. The documentation seems to suggest that it isn't, as most of the examples point towards the other storage types, and running the flow setup locally.
k
Hey @Will, I think it’s upto you but I personally would prefer S3/Git Storage with DockerRun using the container with the common tools because this prevents rebuilds of the entire container. And then from there you can just have a
flows
directory and just register them. You can use the CLI with
prefect register --path folder_path
and it would register the flows there.
This might help too btw
👍 1
I guess the question is how often the common utils change?
w
great, that's really helpful thanks @Kevin Kho