Blake Stefansen
08/25/2022, 7:23 PMs3fs for DockerContainer infrastructure blocks, but this is also an issue for me with the process infrastructure when using prefect cloud. If I run a deployment in the cloud using s3 for filesystem storage and process for infrastructure, our flow runs error out saying
ModuleNotFoundError: No module named 's3fs'
I'm not sure if this is due to our agent being a kubernetes agent and our deployment infrastructure being process , or something else. If the process just runs a subprocess on a docker image made by the kubernetes agent, then I would assume it's an issue with the default image used by the kubernetes agentZanie
s3fs in your agent’s environmentZanie
Zanie
args instead of command you can use the environment variable to install it at startup as described in that issue.Blake Stefansen
08/25/2022, 8:26 PMEXTRA_PIP_PACKAGES environment variable, and I changed command to args as suggested.
However, flow runs from this deployment are simply failing with no log output. See images belowAnna Geller