Blake Stefansen
08/25/2022, 7:23 PMs3fs
for DockerContainer
infrastructure blocks, but this is also an issue for me with the process
infrastructure when using prefect cloud. If I run a deployment in the cloud using s3
for filesystem storage and process
for infrastructure, our flow runs error out saying
ModuleNotFoundError: No module named 's3fs'
I'm not sure if this is due to our agent being a kubernetes
agent and our deployment infrastructure being process
, or something else. If the process
just runs a subprocess on a docker image made by the kubernetes agent, then I would assume it's an issue with the default image used by the kubernetes agentZanie
08/25/2022, 7:32 PMs3fs
in your agent’s environmentargs
instead of command
you can use the environment variable to install it at startup as described in that issue.Blake Stefansen
08/25/2022, 8:26 PMEXTRA_PIP_PACKAGES
environment variable, and I changed command
to args
as suggested.
However, flow runs from this deployment are simply failing with no log output. See images belowAnna Geller
08/26/2022, 11:11 AM