Hello everyone,
I’m currently setting up a deployment that includes an ECSTask infrastructure block and an S3 storage block. To customize the ECSTask, I’m using a custom docker image with the dockerfile below
So, my question is: What is missing from my Dockerfile image or Deployment object so it retrieves the flow correctly from the downloaded files in the S3 storage?
Thank you in advance for any help you can provide.
✅ 1
r
Ryan Peden
04/20/2023, 11:57 PM
I would try adding
fsspec==2023.1.0
to your
pip install
line.
It looks like fsspec 2023.4.0 is included in the latest
Thanks for your suggestions @Ryan Peden!
I just did a test running a simple flow with the default prefect image and was getting the same error. So I read online that adding
path=""
to the deployment can help fixing it and it indeed worked! I’m trying now with my own image, but seems like this was the error.
r
Ryan Peden
04/21/2023, 12:14 AM
thanks for sharing the solution! I'm glad to hear it worked
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.