I have an issue in my production environment. I h...
# ask-community
e
I have an issue in my production environment. I have a dev and prod kube cluster, managed with helm. Jobs are running fine in pods in dev; however, all the jobs in prod are failing with the following error
Copy code
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"events is forbidden: User \"system:serviceaccount:prefect:prefect-worker\" cannot list resource \"events\" in API group \"\" in the namespace \"<redacted>\"","reason":"Forbidden","details":{"kind":"events"},"code":403}
I checked my dev prefect role and I don't see "events", so not sure why dev is working fine and prod is not
Copy code
jobs.batch   []                 []              [get list watch create update patch delete]
  pods/log     []                 []              [get watch list]
  pods/status  []                 []              [get watch list]
  pods         []                 []              [get watch list]
Please advise
k
the api group "" (empty string) is known as "core" and the worker helm chart provides pretty comprehensive permissions on the role for that group
I'd double check not only the permissions on the role but also that namespaces line up as expected
e
I redeployed the images used for the prefect jobs and things are running now
I'm not sure what happend
But urgency is gone for now
k
yeah I was going to recommend that as a last resort. not sure what happened but glad you got things working again
e
Thank you for the prompt reply!