William Clark
12/13/2021, 8:15 PMKevin Kho
12/13/2021, 8:20 PMWilliam Clark
12/13/2021, 8:56 PMKevin Kho
12/13/2021, 9:42 PMAnna Geller
12/13/2021, 10:19 PMflow.run_config = ECSRun(
task_definition="<s3://bucket/flow_task_definition.yaml>",
image="<http://XXXX.dkr.ecr.us-east-1.amazonaws.com/image_name:latest|XXXX.dkr.ecr.us-east-1.amazonaws.com/image_name:latest>",
cpu="2 vcpu",
)
this is how an example task definition YAML can look like:
family: prefectFlow
requiresCompatibilities:
- FARGATE
networkMode: awsvpc
cpu: 1024
memory: 2048
taskRoleArn: arn:aws:iam::XXX:role/prefectTaskRole
executionRoleArn: arn:aws:iam::XXX:role/prefectECSAgentTaskExecutionRole
containerDefinitions:
- name: flow
image: "<http://XXX.dkr.ecr.us-east-1.amazonaws.com/image_name:latest|XXX.dkr.ecr.us-east-1.amazonaws.com/image_name:latest>"
essential: true
environment:
- name: AWS_RETRY_MODE
value: "adaptive"
- name: AWS_MAX_ATTEMPTS
value: "10"
logConfiguration:
logDriver: awslogs
options:
awslogs-group: "/ecs/prefectEcsAgent"
awslogs-region: "us-east-1"
awslogs-stream-prefix: "ecs"
awslogs-create-group: "true"