Andre Cavalheiro
10/20/2024, 8:02 PM16:43:30.481 | INFO | prefect.flow_runs.worker - Creating Kubernetes job...
16:43:30.547 | INFO | prefect.flow_runs.worker - Job 'notorious-pillbug-zf7c7': Starting watch for pod start...
16:43:30.565 | ERROR | prefect.flow_runs.worker - An error occurred while monitoring flow run 'b8f46f0d-0a09-4cf5-870c-cb3936b4ccee'. The flow run will not be marked as failed, but an issue may have occurred.
(...)
kubernetes_asyncio.client.exceptions.ApiException: (403)
Reason: Forbidden: pods is forbidden: User "system:serviceaccount:prefect:prefect-worker" cannot watch resource "pods" in API group "" in the namespace "default"
It seems the worker is attempting some sort of interaction with the "default" namespace which is weird, since I followed the guide recommendation to set everything on a new namespace prefect
. Anyways, there's some error during the setup and and the worker never even starts running the flow.
⢠Helm version v3.12.2
⢠Prefect Worker Chart App Version 3.0.9
Andre Cavalheiro
10/20/2024, 8:03 PMvalues.yaml
namespaceOverride: prefect
worker:
cloudApiConfig:
accountId: ***
workspaceId: ***
config:
workPool: ***
Nate
10/20/2024, 8:25 PMprefect work-pool inspect <your-pool>
or in the UI, which namespace is your work pool configured to run jobs in?Andre Cavalheiro
10/20/2024, 8:35 PMAndre Cavalheiro
10/20/2024, 8:35 PMNate
10/20/2024, 8:36 PMNate
10/20/2024, 8:44 PMAndre Cavalheiro
10/20/2024, 8:46 PM