Matt Melgard
08/30/2022, 3:54 PMRuntimeError: File system created with scheme 'gcs' from base path '<gcs://mattmelgard-test-bucket-01>' could not be created. You are likely missing a Python module required to use the given storage protocol.
This is the CLI command I’m using to build the deployment:
prefect deployment build tutorial-flow/flow/tutorial-flow.py:my_flow -n tutorial-flow-k8s -t test -i kubernetes-job -sb gcs/tutorial-bucket
and I have a block defined for the bucket with the name tutorial-bucket
but I’m not sure what could be missing here, I have pretty much all the python packages installed via pip install 'prefect[all_extras]'
Kevin Grismore
08/30/2022, 3:55 PMpip install gcsfs
in the env you're using prefect in. It'll also need to be installed in the image you're pulling in your kubernetes job to download the files from your bucket.Matt Melgard
08/30/2022, 4:08 PMKevin Grismore
08/30/2022, 4:09 PM