I'd like to add a google cloud storage bucket to m...
# prefect-gcp
s
I'd like to add a google cloud storage bucket to my cloud-run-v2 workers since cloud run storage is a memory filesystem with only 8GB storage. Does anyone have a working configuration to do so? I have tried a few iterations of creating custom base templates and still cannot get things quite right, apparently. The YAML that I'd like to roughly emulate (that works as a cloud run v2 job) is:
Copy code
metadata:
  name: volumetest
  annotations:
    run.googleapis.com/launch-stage: BETA

spec:
  template:
    metadata:
      annotations:
        run.googleapis.com/execution-environment: gen2
    spec:
      taskCount: 1
      template:
        spec:
          containers:
          - image: busybox
            command:
            - touch
            - /data/abc
            volumeMounts:
              - mountPath: /data
                name: data
          volumes:
          - name: data
            csi:
              driver: gcsfuse.run.googleapis.com
              volumeAttributes:
                bucketName: MY_BUCKETNAME
I keep getting an error about the
csi
key not being valid when I use a custom base template in prefect. If someone has accomplished adding GCS bucket to the worker config, I'd appreciate any help. If no one has tried, I can share more details.