Tense Fragile
08/25/2021, 12:33 PMKevin Kho
pip install -e .
would pull the latest version.
If it is the actual Flow code, it likely would have to be reregistered. So for a CI/CD approach, you can either use Docker
storage and package everything up in a single container. When the container is loaded by the agent, everything will be up to date. Some users don’t like this because it means you have to rebuild the container every time.
The second approach is to store it somewhere like Gitlab, or S3 where the agent will pull it down to execute. Again though, the Flow code should be re-registered if any of the metadata is changing (task graph or RunConfig/Storage/Caching/etc.)Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by