Working on migrating to Prefect 2. In prefect 1, we built separate images for each flow and we’d like to tighten that up in our prefect 2 implementation. I really like the idea of github storage, but in our environment, we have a lot of unrelated, disparate flows with different dependencies. We can’t really predict the last 2% of dependencies that might be needed for any give flow.
What are some ways to work around that if we used Github storage?
r
redsquare
01/27/2023, 11:20 AM
If you have your base image based on prefect you can add in any deps on top with
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.