https://prefect.io logo
Title
m

Matt Melgard

08/30/2022, 3:54 PM
Hey all, has anyone seen this error when attempting to use a GCS storage backend?
RuntimeError: File system created with scheme 'gcs' from base path '<gcs://mattmelgard-test-bucket-01>' could not be created. You are likely missing a Python module required to use the given storage protocol.
This is the CLI command I’m using to build the deployment:
prefect deployment build tutorial-flow/flow/tutorial-flow.py:my_flow -n tutorial-flow-k8s -t test -i kubernetes-job -sb gcs/tutorial-bucket
and I have a block defined for the bucket with the name
tutorial-bucket
but I’m not sure what could be missing here, I have pretty much all the python packages installed via
pip install 'prefect[all_extras]'
1
k

Kevin Grismore

08/30/2022, 3:55 PM
you need to
pip install gcsfs
in the env you're using prefect in. It'll also need to be installed in the image you're pulling in your kubernetes job to download the files from your bucket.
m

Matt Melgard

08/30/2022, 4:08 PM
gotcha, okay, good to know!
thank you
k

Kevin Grismore

08/30/2022, 4:09 PM
no problem 🙂