Yupei Chen
08/01/2022, 6:37 PMfrom prefect.filesystems import S3
s3_block = S3.load("dev")
ModuleNotFoundError: No module named ‘s3fs’
ImportError: Install s3fs to access S3
RuntimeError: File system created with scheme ‘s3’ from base path ‘s3://vodori-prefect-orion’ could not be created. You are likely missing a Python module required to use the given storage protocol.
An exception occurred.
On Prefect 2.0.1ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
boto3 1.24.19 requires botocore<1.28.0,>=1.27.19, but you have botocore 1.24.21 which is incompatible.
Rob Freedy
08/02/2022, 1:53 AMYupei Chen
08/02/2022, 2:00 AMredsquare
08/03/2022, 10:58 AMRob Freedy
08/03/2022, 1:02 PMpip install botocore==1.27.19
? Was this dependency previously installed in your environment?redsquare
08/03/2022, 1:13 PMRob Freedy
08/03/2022, 9:42 PMMarvin
08/03/2022, 9:42 PMRob Freedy
08/03/2022, 9:43 PMChris Pickett
08/03/2022, 11:35 PMpip uninstall s3fs gcsfs
pip install --upgrade aiobotocore boto3 aiobotocore
pip install s3fs
Alternatively, you could install an older version of s3fs that’s happy with your version of the boto packages which appears to be version `2022.5.0`:
pip install s3fs==2022.5.0
James Brady
08/12/2022, 11:42 AMpip
commands be placed?
I ran into the "No module named ‘s3fs’" error when running a flow in a kubernetes deployment – using the default docker image etc.