https://prefect.io logo
Title
j

jack

01/10/2023, 8:47 PM
At runtime how do we access artifacts stored in S3 block storage? (Prefect v2) Are all artifacts copied to some location when the flow run begins?
For example, say we have a command line tool named
fazer
which expects an xml file as an argument. Normally we would run
/usr/sbin/fazer some-file.xml
In prefect v2, can we package up the xml file and have it available in a particular directory at runtime?
r

redsquare

01/10/2023, 9:37 PM
j

jack

01/10/2023, 9:40 PM
We use S3 block storage to upload artifacts. But it's not clear from the documentation how to retrieve (non-python) artifacts from that storage to use them at runtime.
r

redsquare

01/10/2023, 9:43 PM
it uploads the entire workflow folder and obviously downloads when run, allowing for relative imports and static configuration files