Peter Nagy
02/25/2023, 6:26 PMg5.4xlarge
EC2s in an an ASG with an amazon ecs-optimized linux gpu AMI. Here is how I am calling ECSTask:
ECSTask(
command=["echo", "hello world"],
image="<http://xxxxxxxxxxxx.dkr.ecr.eu-central-1.amazonaws.com/my_repo:my_image|xxxxxxxxxxxx.dkr.ecr.eu-central-1.amazonaws.com/my_repo:my_image>",
launch_type="EC2",
cluster="my-cluster",
stream_output=True,
execution_role_arn="arn:aws:iam::xxxxxxxxxxxx:role/prefect-ecs-task-role",
).run()
If anyone could help me figure out what I could try to get this working, I would be really grateful.Christopher Boyd
02/27/2023, 8:08 PMPeter Nagy
02/28/2023, 6:46 AMprefect_aws.ecs.EssentialContainerExited: Essential container in task exited
, so I am guessing that it is an ECS failure reported by Prefect. The task goes to a PENDING
status, but then abruptly stops. I also attached a screenshot of the full traceback.
The issue is also weird, as on Fargate the same Docker image runs without problems, and one time on EC2 it also ran with the same config - since then I did not get it to work though.
Thanks for your help!Christopher Boyd
02/28/2023, 1:29 PMPeter Nagy
02/28/2023, 4:41 PMChristopher Boyd
02/28/2023, 5:34 PM@flow(log_prints=True)
to send them to the prefect logger by default. Beyond that, I don’t see any logs or indication to point to a failurePeter Nagy
03/01/2023, 5:56 AMessential container in task exited
error from prefect_aws
if seemingly everything is running fine?