Hello, I've had good success deploying with prefect in subprocess, docker locally and also with ECR....
j

Jafar A

over 2 years ago
Hello, I've had good success deploying with prefect in subprocess, docker locally and also with ECR. Now when it comes to k8s, docker desktop k8s is running (green with k8s_POD_prefect-k8s-... running) but prefect says Pod never started! I followed a post by @Jeff Hale and this is my build:
prefect deployment build flows/main.py:ingest_everflow \
-n prefect-k8s-example -q k8s \
-sb s3/s3-everflow/ef_testing/docker-k8s-image \
-ib kubernetes-job/prefect-k8s-example \
--apply
14:40:49.825 | INFO    | prefect.agent - Submitting flow run '99f81791-abda-488f-802e-d949535cb351'
/Users/jafaramin_1/env/lib/python3.10/site-packages/prefect/agent.py:216: UserWarning: Block document has schema checksum sha256:1a553852c1bcc9cd95645917bdbaaae9e28cbcc1270ff5b43b45bbd87564f5cc which does not match the schema checksum for class 'KubernetesJob'. This indicates the schema has changed and this block may not load.
  infrastructure_block = Block._from_block_document(infra_document)
14:40:50.538 | INFO    | prefect.agent - Completed submission of flow run '99f81791-abda-488f-802e-d949535cb351'
14:40:50.546 | DEBUG   | prefect.infrastructure.kubernetes-job - Job 'prefect-k8s-example-mwmgm': Starting watch for pod start...
14:40:50.555 | INFO    | prefect.infrastructure.kubernetes-job - Job 'prefect-k8s-example-mwmgm': Pod has status 'Pending'.
14:40:54.827 | DEBUG   | prefect.agent - Checking for flow runs...
14:40:59.925 | DEBUG   | prefect.agent - Checking for flow runs...
14:42:50.560 | ERROR   | prefect.infrastructure.kubernetes-job - Job 'prefect-k8s-example-mwmgm': Pod never started.