Hello, I have an agent set up on ECS and built a deployment using the ECStask block to run the flow as a Fargate task. I tried to run the deployment and the flow run failed. I have no information as to why though. The logs are completely empty, it says "This run didn't generate Logs". There is also no logs in AWS for the task I was intending to run so it seems like it failed before the task even started.

did you create the ECS agent like in this example repo? https://github.com/anna-geller/dataflow-ops/tree/main/infrastructure

No I created according to this. https://github.com/PrefectHQ/prefect-recipes/tree/main/devops/infrastructure-as-code/aws/cli-prefect2-ecs-agent. Did you have the same issue that there were no logs when you tried to run?

I think those cli commands will only get you as far as having a prefect agent process running in ECS Fargate. It would be able to run in-process tasks (same container as the agent), but to get it to spin up other ECS fargate containers to run tasks, a bit more is required

Yeah it already has the permission to run ecs tasks and the task definition is created - I am running an existing task definition. So I would think the ability to run an ecs task is the only permission needed.

hmm two questions: • does your ECSTask block specify an image? • did you include

ecs:DescribeTasks

as well?

Yes to the first, will check on the second.

ok, try setting the image to None

Got it, I actually tried to remove the image before. I edit, remove, save. But when I refresh the page, the image is still there. Just tried again.

oh weird. Were talking about the ECSTask block, right?

Yup correct

Well if its some kind of UI bug, Prefect will need to look into that. But I can show you how I set up our own ECSTask block:

from prefect_aws.ecs import ECSTask

ecs = ECSTask(
    name="Run ecs task in fargate using pre-existing task definition",
    image=None,
    task_definition_arn=f"arn:aws:ecs:us-east-1:00000000:task-definition/my_task_defintion_name:1",
    cpu=1024,
    memory=2048,
    stream_output=True,
    launch_type="FARGATE",
    configure_cloudwatch_logs=True,
    vpc_id="vpc-00000000",
    cluster="prefect",
    task_start_timeout_seconds=180,
    execution_role_arn="arn:aws:iam::0000000000:role/dataflowops_ecs_execution_role",
    task_role_arn="arn:aws:iam::000000000:role/dataflowops_ecs_task_role",
    task_customizations=[
        {
            "op": "add",
            "path": "/networkConfiguration/awsvpcConfiguration/subnets",
            "value": ["subnet-000000000", "subnet-00000000"],
        },
    ],
)
ecs.save("ecs-fargate", overwrite=True)