Hi, How i can store all task result of flow in specific S3 prefix?
k
Kevin Kho
01/20/2022, 7:04 AM
The flow location needs to be defined at registration time or templated to be filled at runtime. If you know the prefix at registration time, you can just add it to the string you set. If you need it at runtime, i think you need to do it through a Parameter as shown here
s
Suresh R
01/20/2022, 7:05 AM
Shall i pass same location to all tasks?
Suresh R
01/20/2022, 7:07 AM
Will prefect use some uuid in filename to differentiate it, or it will overwrite in whatever location i provide?
k
Kevin Kho
01/20/2022, 7:10 AM
If you provide the same location to all tasks, it will overwrite. It won’t differentiate, but you can add the
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.