all day, any idea what's up?
I have mapped functions that around 3-4k iterations.
by the time I am around half of it. I hit this error and it crashes on its own.
When I retry, by the time it finds all completed tasks (checkpoints), it will raise the error again and won't move forward.
using prefect:2.10.10-python3.10 and running on ecs with s3 result storage
c
Christopher Boyd
05/26/2023, 12:43 PM
Hi Nikhil ,
On the surface from your description it does seem likely that you are indeed hitting published rate limits which are available here for review.
For more help dealing with the 429s, I’d encourage you to book a time with one of our product advocates, they’d be happy to help:
https://calendly.com/prefect-experts/rubber-duck
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.