Hey @Brad Clark! This is a great question and I think that it depends on what you’re trying to do. The
GCS
block can read and write file and full directories from GCS but doesn’t offer many configuration options. The tasks in
prefect_gcp.cloud_storage
offer more configuration options, but don’t support reading and writing full directories out of the box. The amount of configuration that you need would determine which to reach for. Long term, you can expect to see a lot of the GCS functionality centralize in the
GcsBucket
block which resides in
prefect_gcp.cloud_storage
. Our goal is to make that the go to solution for interacting with GCS buckets.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.