Hi!
Is there any guidance on best practice for structuring a Python project of Prefect flows?
For example - one project per flow, with common methods in private repos?
Or one mega project with separate folders/scripts for flows, tasks, methods?
Edit: there are extreme examples I just wonder if there is any reading anywhere on this topic?
a
Anna Geller
01/14/2022, 11:37 AM
Great question! Prefect tries to be unopinionated in that regard so that you can do whatever approach suits your use case. One repo per project makes sense if all your flows are entirely different projects, but if your flows need to share some code, then a common repository for some flows can be more optimal. This Github discussion shows some examples from the community and this repo shows one example I built to package flows with common dependencies.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.