wave Hi I m probably surely missing something very simple I

Question

wave Hi I m probably surely missing something very simple I m currently not able to load a bucket from a GCS block using `GcsBucket load` classmethod following the reference <https prefecthq github io prefect gcp cloud storage |here> ```ValueError Unable to find block document named tam 2759 bucket for block type gcs bucket``` More details in the thread thread

Miguel Moncada · Answer

I m authenticated via CLI to the correct account I ve double checked the API URL and the block exists in the cloud version

Miguel Moncada · Answer

Moreover I m able to use the bucket using the code snippet offered by the UI though it is my understanding that `GcsBucket` class has further options and it s the preferred way to go ```logger = get run logger Starting flow bucket gcs = GCS load GCS BUCKET BLOB f Bucket bucket gcs loaded ``` ``` python tam 2759 flow py 09 44 22 436 | INFO | prefect engine Created flow run tunneling horse for flow tam 2759 flow 09 44 23 376 | INFO | Flow run tunneling horse Starting flow 09 44 23 668 | INFO | Flow run tunneling horse Bucket GCS bucket path= bucket name service account info=SecretStr project= gcp project name loaded```

Miguel Moncada · Answer

Flow ```from prefect import task flow get run logger from prefect gcp cloud storage import GcsBucket from utils tam 2759 utils import check is candidate file from uri from utils tam 2759 constants import GCS BUCKET BLOB FILE MAX OLD DAYS task name= get gcs candidate upload files retries=0 retry delay seconds=1 timeout seconds=5 def get gcs candidate upload files bucket GcsBucket days period int = FILE MAX OLD DAYS gt list Function to get the list of files to process Args bucket GcsBucket GCS bucket object days period int optional Days period to check if a file is valid to process Defaults to FILE MAX OLD DAYS Returns list List of files to process logger = get run logger blob list = bucket list blobs if blob list f Found len blob list files in bucket f GcsBucket bucket else logger warning f No files found in bucket GcsBucket bucket return check is candidate file from uri blob name days period=days period for blob in blob list flow name= tam 2759 flow def main logger = get run logger Starting flow bucket = GcsBucket load GCS BUCKET BLOB f Bucket bucket loaded candidate files = get gcs candidate upload files bucket=bucket candidate files main ```

Miguel Moncada · Answer

Prefect Google Cloud versions ``` pip freeze | grep i prefect |google google api core==2 11 0 google api python client==2 70 0 google auth==2 15 0 google auth httplib2==0 1 0 google auth oauthlib==0 8 0 google cloud==0 34 0 google cloud bigquery==3 4 1 google cloud core==2 3 2 google cloud storage==2 7 0 google crc32c==1 5 0 google resumable media==2 4 0 googleapis common protos==1 57 0 prefect==2 7 5 prefect dask==0 2 2 prefect gcp==0 2 2```

alex · Answer

Hey < Miguel Moncada> You ve created a `GCS` block in the UI but you re using the `GcsBucket` class from `prefect gcp` If you want to load the block you created in the UI you ll need to use the `GCS` class from `prefect filesystems`

Miguel Moncada · Answer

How can I benefit from a `GcsBucket` class object using the credentials stored in a GCS block

alex · Answer

Great question You can register the blocks from `prefect gcp` with the command `prefect blocks register m prefect gcp` The blocks in `prefect gcp` will be available in your UI and available for configuration after that

Miguel Moncada · Answer

Oh thanks a lot I can see the new available block types now Is there any use case in which I would like to have both `GCS` and `GCS bucket` blocks defined

alex · Answer

I can t think of a use case where you would need both

Miguel Moncada · Answer

Thanks < alex> it seems that if I m not missing something `GCS Bucket` block offers more functionality than `GCS` so I ll try to stick to this one If that was the case and just out of curiosity are there any plans on keeping only one of them in the future