Hey all, has anyone seen this error when attemptin...
# prefect-community
m
Hey all, has anyone seen this error when attempting to use a GCS storage backend?
Copy code
RuntimeError: File system created with scheme 'gcs' from base path '<gcs://mattmelgard-test-bucket-01>' could not be created. You are likely missing a Python module required to use the given storage protocol.
This is the CLI command I’m using to build the deployment:
Copy code
prefect deployment build tutorial-flow/flow/tutorial-flow.py:my_flow -n tutorial-flow-k8s -t test -i kubernetes-job -sb gcs/tutorial-bucket
and I have a block defined for the bucket with the name
tutorial-bucket
but I’m not sure what could be missing here, I have pretty much all the python packages installed via
pip install 'prefect[all_extras]'
1
k
you need to
pip install gcsfs
in the env you're using prefect in. It'll also need to be installed in the image you're pulling in your kubernetes job to download the files from your bucket.
m
gotcha, okay, good to know!
thank you
k
no problem 🙂