Brian Roepke
02/14/2024, 7:47 PMMarvin
02/14/2024, 7:48 PMBrian Roepke
02/14/2024, 7:49 PMNate
02/14/2024, 10:28 PMBrian Roepke
02/14/2024, 10:33 PMNate
02/14/2024, 10:41 PMNate
02/14/2024, 10:41 PMBrian Roepke
02/14/2024, 11:01 PMprefect_aws.workers.ecs_worker.TaskFailedToStart: CannotPullContainerError: pull image manifest has been retried 5 time(s): failed to resolve ref <http://docker.io/prefecthq/prefect:2-latest|docker.io/prefecthq/prefect:2-latest>: failed to do request: Head "<https://registry-1.docker.io/v2/prefecthq/prefect/manifests/2-latest>": dial tcp 54.196.99.49:443: i/o timeout
Brian Roepke
02/14/2024, 11:03 PMWorker 'ECSWorker 505387fe-631f-455f-b08f-a29878ca00be' submitting flow run '71de195b-7d22-4f4e-a904-f3910a8912c6'
04:32:05 PM
prefect.flow_runs.worker
Retrieving ECS task definition 'arn:aws:ecs:us-east-1:222975130657:task-definition/prefect-worker-task:13'...
04:32:06 PM
prefect.flow_runs.worker
Ignoring task definition in configuration since task definition ARN is provided on the task run request.
04:32:06 PM
prefect.flow_runs.worker
Using ECS task definition 'arn:aws:ecs:us-east-1:222975130657:task-definition/prefect-worker-task:13'...
04:32:06 PM
prefect.flow_runs.worker
Creating ECS task run...
04:32:06 PM
prefect.flow_runs.worker
Waiting for ECS task run to start...
04:32:07 PM
prefect.flow_runs.worker
ECS task status is PROVISIONING.
04:32:07 PM
prefect.flow_runs.worker
ECS task status is PENDING.
04:32:17 PM
prefect.flow_runs.worker
ECS task status is DEPROVISIONING.
04:35:59 PM
prefect.flow_runs.worker
ECS task status is STOPPED.
Brian Roepke
02/14/2024, 11:03 PMBrian Roepke
02/14/2024, 11:05 PM# We're using the latest version of Prefect with Python 3.10
FROM prefecthq/prefect:2-python3.10
# Add our requirements.txt file to the image and install dependencies
COPY requirements.txt .
RUN pip install -r requirements.txt --trusted-host <http://pypi.python.org|pypi.python.org> --no-cache-dir
# Run our flow script when the container starts
CMD ["/bin/sh","-c","prefect worker start --pool my-ecs-pool --type ecs"]
William Fitzmaurice
02/15/2024, 12:33 AMBrian Roepke
02/15/2024, 2:15 PMBrian Roepke
02/15/2024, 2:16 PMNate
02/15/2024, 2:27 PM