Hey everyone,
I'm trying to set up a prefect worker with helm on my VPC, and getting an error with the very basic initial set-up. Wondering if someone has any pointers? i really just followed the getting started guide from
Helm Prefect Worker.
The worker is laucnhed fine, but as soon as a flow run is received to process it fails.
Error Info:
16:43:30.481 | INFO | prefect.flow_runs.worker - Creating Kubernetes job...
16:43:30.547 | INFO | prefect.flow_runs.worker - Job 'notorious-pillbug-zf7c7': Starting watch for pod start...
16:43:30.565 | ERROR | prefect.flow_runs.worker - An error occurred while monitoring flow run 'b8f46f0d-0a09-4cf5-870c-cb3936b4ccee'. The flow run will not be marked as failed, but an issue may have occurred.
(...)
kubernetes_asyncio.client.exceptions.ApiException: (403)
Reason: Forbidden: pods is forbidden: User "system:serviceaccount:prefect:prefect-worker" cannot watch resource "pods" in API group "" in the namespace "default"
It seems the worker is attempting some sort of interaction with the "default" namespace which is weird, since I followed the guide recommendation to set everything on a new namespace
prefect
. Anyways, there's some error during the setup and and the worker never even starts running the flow.
⢠Helm version
v3.12.2
⢠Prefect Worker Chart App Version
3.0.9