I am trying to run a flow through an ECS Agent on FARGATE. I have successfully deployed the prefect agent on cluster. But I'm unable to run a registered flow. I'm using prefect 1.2.2. Logs only say
Submitted for execution: Task arn:
Can anybody suggest a solution?
k
Kevin Kho
06/22/2022, 1:48 PM
Do you have logs on the ECS side?
a
Abhishek Mitra
06/22/2022, 1:54 PM
Yes
k
Kevin Kho
06/22/2022, 1:55 PM
This is agent side logs. Do you have flow side logs?
a
Abhishek Mitra
06/22/2022, 1:56 PM
Only this log
Then it gets restarted by lazarus
k
Kevin Kho
06/22/2022, 1:59 PM
There are many reasons this could fail:
1. Flow doesn’t have needed role
2. Flow can’t pull from Storage
3. Image incompatibility
This failure is happening between ECS launching the task and the Flow starting so there are no more flow logs. I suggest you add ECS logs like this to get more ECS logs into CloudWatch to figure out what the specific error is
Note you have to create the log group
a
Abhishek Mitra
06/22/2022, 2:39 PM
Thanks @Kevin Kho I found it. The issue was with different python runtimes. I solved it