Hey team! We’re looking at upgrading from Prefect1 to 2 in the near future. Currently our prefect services are deployed in house (using terraform and what not), but this allows us to quickly spin up and down new testing environments which use prefect 1.
However, I notice in prefect 2, there are the new concepts of storage blocks, and if we want to continue to use s3 as a host for our flows, it seems like we have to login to a newly created environment and manually create the s3 storage block.
Is there a way (through the API, env variables, other) we can set up an s3 bucket to allow us to keep the entire setup as infrastructure-as-code?
k
Khuyen Tran
12/21/2022, 5:30 PM
We currently don’t support using terraform to create an S3 bucket. Do we have any plan to support this in the future, @Will Raphaelson, @nathaniel?
s
Samuel Hinton
12/21/2022, 11:30 PM
Even if not using tf, I can run it separately to create S3 buckets, I just need a way of getting this information into prefect without having to manually do it 🙂
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.