https://prefect.io logo
Title
r

Ritabrata Moitra

05/17/2023, 4:00 PM
Prefect 2.10.7 self hosted Looks like my ECS task infra block is not honouring the entrypoint offered in the deployment. Instead the
python -m prefect.engine
command just installs the python libraries, and then stalls in
Pending
state. Any pointers here?
ECS task logs -
21:26:21.973 | INFO    | prefect.agent - Submitting flow run 'e0dfff3c-30b9-4645-a013-5b46daa04623'
21:26:22.973 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Retrieving task definition 'prefect__ecs-task-flow__ecs-task-deployment'...
21:26:23.835 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Registering task definition...
21:26:26.224 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Creating task run...
21:26:26.941 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Waiting for task run to start...
21:26:27.139 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is PROVISIONING.
21:26:37.554 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is PENDING.
21:26:58.366 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is RUNNING.
21:27:03.371 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Running command 'python -m prefect.engine' in container 'prefect' (prefecthq/prefect:2.10.7-python3.9)...
21:27:03.385 | INFO    | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Streaming output from container 'prefect'...
21:27:03.634 | INFO    | prefect.agent - Completed submission of flow run 'e0dfff3c-30b9-4645-a013-5b46daa04623'
+pip install prefect-aws
Collecting prefect-aws
  Downloading prefect_aws-0.3.1-py3-none-any.whl (53 kB)

... Other packages downloaded ...

Installing collected packages: urllib3, mypy-boto3-secretsmanager, mypy-boto3-s3, jmespath, botocore, s3transfer, boto3, prefect-aws
  Attempting uninstall: urllib3
    Found existing installation: urllib3 2.0.2
    Uninstalling urllib3-2.0.2:
      Successfully uninstalled urllib3-2.0.2
Successfully installed boto3-1.26.135 botocore-1.29.135 jmespath-1.0.1 mypy-boto3-s3-1.26.127 mypy-boto3-secretsmanager-1.26.135 prefect-aws-0.3.1 s3transfer-0.6.1 urllib3-1.26.15
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: <https://pip.pypa.io/warnings/venv>
[notice] A new release of pip available: 22.3.1 -> 23.1.2
[notice] To update, run: pip install --upgrade pip
/usr/local/lib/python3.9/runpy.py:127: RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour
  warn(RuntimeWarning(msg))
The task stalls here and keeps being stuck with no further progress, without invoking the actual flow function.