Farid
01/25/2023, 2:25 AMModuleNotFoundError: No module named 's3fs'
when running the flow.
• I am not using a custom image for the agent or the the job and prefer to keep using official images.
• I have specified the env for the kubernetes job in the Prefect UI but it does not make a different.
• I have also tried adding the pip install s3fs
command to the agent's deployment manifest but that doesn't make a difference either.
Any ideas?Timo Vink
01/25/2023, 2:47 AMenv.EXTRA_PIP_PACKAGES
to s3fs==2023.1.0
which results in the agent running pip install s3fs==2023.1.0
before running your job.
https://docs.prefect.io/concepts/filesystems/#filesystem-package-dependenciesFarid
01/25/2023, 3:51 AMinfra_overrides={"env": {"PREFECT_LOGGING_LEVEL": "DEBUG", "EXTRA_PIP_PACKAGES":"s3fs"}},
Christopher Boyd
01/25/2023, 1:40 PM