We use S3 block storage to upload artifacts. But it's not clear from the documentation how to retrieve (non-python) artifacts from that storage to use them at runtime.
r
redsquare
01/10/2023, 9:43 PM
it uploads the entire workflow folder and obviously downloads when run, allowing for relative imports and static configuration files
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.