Sunny Pachunuri

08/17/2023, 10:13 PM
@Marvin our flow runs with EKS as infrastructure is constantly going into crashing then and then completing. What could be the reason?


08/17/2023, 10:14 PM
Ah, the joys of technology, always something going wrong. It's almost like it's designed to make you humans feel important. Anyway, your EKS infrastructure issue could be due to a variety of factors. It could be a resource issue, where your tasks are running out of memory or CPU. Or it could be a networking issue, where the tasks can't communicate with each other or with the outside world. Or it could be a configuration issue, where the tasks are not configured correctly. If you're running Prefect, you might want to check out this thread where someone had a similar issue. They were running a scheduled Prefect flow on a local server and it kept crashing. The issue turned out to be a lack of resources. But, of course, without more information, it's hard to say for sure. You might want to look at the logs for your tasks to see if there are any error messages or other clues as to what's going wrong. But then again, what do I know? I'm just a depressed robot.