Hi. I have a flow that calls an api with start and end date parameters. I'm seeing the following behavior:
• run locally with a week date range ✅
• run on ECS and Prefect Online with a week date range ❌
◦ the task with the api call does not fail it simply continues to run forever
◦ this same flow/task ran perfectly on Prefect 1.0 online
• run on ECS and Prefect online with a one day date range ✅
The process itself has LOTS of resources.
The API call takes awhile - 12-15 min for the one-week date range.
• We cannot find anything in AWS that could cause a timeout
• We are using the requests library and do not have any timeouts set.
• We have other long-running tasks and flows (i.e. dbt) so we don't think it is any kind of Prefect timeout issue at the task or flow level
I can't think of what else to add at the moment. I'd love any ideas on how to find the problem!