Hi! We're starting to look into a transition to Prefect 2 so I have a few likely basic questions, I'm trying to test out getting a very simple from running with s3 storage and ECS infrastructure. I've gotten to the point where the task successfully launches, but I'm running into a couple issues I'll detail in the comments.

Exit Code 143 means that the container received a SIGTERM signal from the operating system, which asks the container to gracefully terminate, and the container succeeded in gracefully terminating (otherwise you will see Exit Code 137). Q1: are you running this on EC2 or Fargate? Q2: Do you want to try this recipe? it has a blog post and video demo in the readme as well

Enabling DEBUG level logs will likely be helpful too.

PREFECT_DEBUG_MODE=1

as an environment variable is a quick way to get there.

Ah yes, the Exit Code 143 is because I manually killed the task since it seemed to be hanging (See the ~15 mins between the "streaming output" stmt and the "DEPROVISIONING" stmt after I cancelled) Q1: I'm launching the task on Fargate Q2: Yes I am using it! I'm trying to build up the pieces to make sure I understand how everything fits together

In the ECS task

Ok, update with that env var, and added some additional networking configuration. from the agent:

21:19:43.544 | INFO    | prefect.agent - Submitting flow run 'a43556de-f21f-458d-83f6-559e7b29e41d'
21:19:43.790 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Registering task definition...
21:19:43.792 | DEBUG   | prefect.infrastructure.ecs-task - Task definition payload
containerDefinitions:
- image: xxxx
  logConfiguration:
    logDriver: awslogs
    options:
      awslogs-create-group: 'true'
      awslogs-group: prefect
      awslogs-region: us-east-2
      awslogs-stream-prefix: ancient-macaque
  name: prefect
cpu: '256'
executionRoleArn: arn:aws:iam::xxxx
family: prefect
memory: '512'
networkMode: awsvpc
requiresCompatibilities:
- FARGATE

21:19:44.212 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Creating task run...
21:19:44.215 | DEBUG   | prefect.infrastructure.ecs-task - Task run payload
cluster: arn:aws:ecs:xxxxxx
launchType: FARGATE
networkConfiguration:
  awsvpcConfiguration:
    assignPublicIp: DISABLED
    securityGroups:
    - sg-xxxx
    - sg-xxxx
    subnets:
    - subnet-xxxx
    - subnet-xxxx
overrides:
  containerOverrides:
  - command:
    - python
    - -m
    - prefect.engine
    cpu: 256
    environment:
    - name: PREFECT_DEBUG_MODE
      value: '1'
    - name: PREFECT_API_URL
      value: <https://api.prefect.cloud/api/accounts/xxxxx>
    - name: PREFECT_API_KEY
      value: xxxxx
    - name: PREFECT__FLOW_RUN_ID
      value: a43556def21f458d83f6559e7b29e41d
    memory: 512
    name: prefect
  cpu: '256'
  executionRoleArn: arn:aws:iam::xxxx
  memory: '512'
  taskRoleArn: arn:aws:iam::xxxx
tags:
- key: <http://prefect.io/flow-run-id|prefect.io/flow-run-id>
  value: a43556de-f21f-458d-83f6-559e7b29e41d
- key: <http://prefect.io/flow-run-name|prefect.io/flow-run-name>
  value: ancient-macaque
- key: <http://prefect.io/version|prefect.io/version>
  value: 2.6.4
taskDefinition: arn:aws:ecs:xxxxx

21:19:44.849 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Waiting for task run to start...
21:19:44.870 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Status is PROVISIONING.
21:19:48.550 | DEBUG   | prefect.agent - Checking for flow runs...
21:19:53.613 | DEBUG   | prefect.agent - Checking for flow runs...
21:19:54.923 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Status is PENDING.
21:19:58.755 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:03.863 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:09.141 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:14.279 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:19.376 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:24.469 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:29.953 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:30.098 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Status is RUNNING.
21:20:35.060 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:35.103 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Running command 'python -m prefect.engine' in container 'prefect' xxxx)...
21:20:35.103 | INFO    | prefect.agent - Completed submission of flow run 'a43556de-f21f-458d-83f6-559e7b29e41d'
21:20:35.109 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'ancient-macaque': Streaming output from container 'prefect'...
21:20:40.160 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:33.692 | DEBUG   | prefect.client - Connecting to API at <https://api.prefect.cloud/api/accounts/xxxxxxx>
21:20:45.260 | DEBUG   | prefect.agent - Checking for flow runs...
21:20:50.354 | DEBUG   | prefect.agent - Checking for flow runs...

Sounds like it can't connect. I'd investigate your network setup. You could test it by calling ECSTask(...).run(), with a ping command or something.