Matt Melgard08/30/2022, 3:54 PM
This is the CLI command I’m using to build the deployment:
RuntimeError: File system created with scheme 'gcs' from base path '<gcs://mattmelgard-test-bucket-01>' could not be created. You are likely missing a Python module required to use the given storage protocol.
and I have a block defined for the bucket with the name
prefect deployment build tutorial-flow/flow/tutorial-flow.py:my_flow -n tutorial-flow-k8s -t test -i kubernetes-job -sb gcs/tutorial-bucket
but I’m not sure what could be missing here, I have pretty much all the python packages installed via
pip install 'prefect[all_extras]'
Kevin Grismore08/30/2022, 3:55 PM
in the env you're using prefect in. It'll also need to be installed in the image you're pulling in your kubernetes job to download the files from your bucket.
pip install gcsfs
Matt Melgard08/30/2022, 4:08 PM
Kevin Grismore08/30/2022, 4:09 PM