https://prefect.io logo
Title
f

Felipe

04/20/2023, 10:26 PM
Hello everyone, I’m currently setting up a deployment that includes an ECSTask infrastructure block and an S3 storage block. To customize the ECSTask, I’m using a custom docker image with the dockerfile below So, my question is: What is missing from my Dockerfile image or Deployment object so it retrieves the flow correctly from the downloaded files in the S3 storage? Thank you in advance for any help you can provide.
r

Ryan Peden

04/20/2023, 11:57 PM
I would try adding
fsspec==2023.1.0
to your
pip install
line. It looks like fsspec 2023.4.0 is included in the latest
prefecthq/prefect:2-python3.10
image build, and it reportedly causes the
FileNotFound
problem: https://github.com/PrefectHQ/prefect/issues/9262 That issue is about Azure storage, not S3, but the S3 and Azure blocks both use
fsspec
. You could also try
S3Bucket
storage from the
prefect-aws
collection, because it doesn't use
fsspec
at all: https://prefecthq.github.io/prefect-aws/blocks_catalog/#s3-module
f

Felipe

04/21/2023, 12:14 AM
Thanks for your suggestions @Ryan Peden! I just did a test running a simple flow with the default prefect image and was getting the same error. So I read online that adding
path=""
to the deployment can help fixing it and it indeed worked! I’m trying now with my own image, but seems like this was the error.
r

Ryan Peden

04/21/2023, 12:14 AM
thanks for sharing the solution! I'm glad to hear it worked