Ritabrata Moitra
05/17/2023, 4:00 PMpython -m prefect.engine
command just installs the python libraries, and then stalls in Pending
state. Any pointers here?21:26:21.973 | INFO | prefect.agent - Submitting flow run 'e0dfff3c-30b9-4645-a013-5b46daa04623'
21:26:22.973 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Retrieving task definition 'prefect__ecs-task-flow__ecs-task-deployment'...
21:26:23.835 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Registering task definition...
21:26:26.224 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Creating task run...
21:26:26.941 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Waiting for task run to start...
21:26:27.139 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is PROVISIONING.
21:26:37.554 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is PENDING.
21:26:58.366 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Status is RUNNING.
21:27:03.371 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Running command 'python -m prefect.engine' in container 'prefect' (prefecthq/prefect:2.10.7-python3.9)...
21:27:03.385 | INFO | prefect.infrastructure.ecs-task - ECSTask 'versed-ocelot': Streaming output from container 'prefect'...
21:27:03.634 | INFO | prefect.agent - Completed submission of flow run 'e0dfff3c-30b9-4645-a013-5b46daa04623'
+pip install prefect-aws
Collecting prefect-aws
Downloading prefect_aws-0.3.1-py3-none-any.whl (53 kB)
... Other packages downloaded ...
Installing collected packages: urllib3, mypy-boto3-secretsmanager, mypy-boto3-s3, jmespath, botocore, s3transfer, boto3, prefect-aws
Attempting uninstall: urllib3
Found existing installation: urllib3 2.0.2
Uninstalling urllib3-2.0.2:
Successfully uninstalled urllib3-2.0.2
Successfully installed boto3-1.26.135 botocore-1.29.135 jmespath-1.0.1 mypy-boto3-s3-1.26.127 mypy-boto3-secretsmanager-1.26.135 prefect-aws-0.3.1 s3transfer-0.6.1 urllib3-1.26.15
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: <https://pip.pypa.io/warnings/venv>
[notice] A new release of pip available: 22.3.1 -> 23.1.2
[notice] To update, run: pip install --upgrade pip
/usr/local/lib/python3.9/runpy.py:127: RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour
warn(RuntimeWarning(msg))
The task stalls here and keeps being stuck with no further progress, without invoking the actual flow function.