What options are available for storing and running flows that span multiple files (e.g., flow.py, flow_tasks.py)?
k
Kevin Kho
01/12/2022, 1:32 AM
Pretty much Docker storage will be the main one. If for example, you have helpers that don’t change a lot, you can do something like Github/S3 Storage + Docker Run to avoid the rebuilds.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.