Blake Stefansen
08/25/2022, 7:23 PMs3fs
for DockerContainer
infrastructure blocks, but this is also an issue for me with the process
infrastructure when using prefect cloud. If I run a deployment in the cloud using s3
for filesystem storage and process
for infrastructure, our flow runs error out saying
ModuleNotFoundError: No module named 's3fs'
I'm not sure if this is due to our agent being a kubernetes
agent and our deployment infrastructure being process
, or something else. If the process
just runs a subprocess on a docker image made by the kubernetes agent, then I would assume it's an issue with the default image used by the kubernetes agentZanie
s3fs
in your agent’s environmentZanie
Zanie
args
instead of command
you can use the environment variable to install it at startup as described in that issue.Blake Stefansen
08/25/2022, 8:26 PMEXTRA_PIP_PACKAGES
environment variable, and I changed command
to args
as suggested.
However, flow runs from this deployment are simply failing with no log output. See images belowAnna Geller