Been receiving these error messages. Weird! Can an...
# prefect-communityd
Deceivious
05/10/2023, 7:15 PMBeen receiving these error messages. Weird! Can anyone explain?
Copy code
Submission failed. kubernetes.client.exceptions.ApiException: (500) Reason: Internal Server Error HTTP response headers: HTTPHeaderDict({'Audit-Id': '6d00e224-73e9-4d44-bfce-d0589101f116', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'Warning': '299 - "unknown field \\"spec.template.spec.parallelism\\"", 299 - "unknown field \\"spec.template.spec.completions\\""', 'X-Kubernetes-Pf-Flowschema-Uid': 'e8e112c2-396a-440d-a000-51271ccde7dd', 'X-Kubernetes-Pf-Prioritylevel-Uid': 'a49f8ad5-8431-4216-90ae-cd35c64b0736', 'Date': 'Wed, 10 May 2023 18:30:59 GMT', 'Content-Length': '161'}) HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"rpc error: code = Unknown desc = exec (try: 500): database is locked","code":500}n
Nate
05/10/2023, 7:24 PMhi @Deceivious - are you running against Prefect Cloud?
d
Deceivious
05/10/2023, 7:25 PMNope
Deceivious
05/10/2023, 7:25 PMwell atleast this issue isnt in cloud
Deceivious
05/10/2023, 7:25 PMwe use both version
z
Zanie
05/10/2023, 7:45 PM
Hm that looks like a Kubernetes internal error?
d
Deceivious
05/10/2023, 7:53 PMThanks ill scope it out tomorrow and if I discover something ill let you know if its related to prefect
Deceivious
05/10/2023, 9:31 PMUmmm @Nate, @Zanie
Unsure if this is an issue. But the status is shown as "Failed" and not "Crashed". At this point when the pod itself failed to spawn, , the
on_failureDeceivious
05/10/2023, 9:31 PMimage.png
Deceivious
05/10/2023, 9:32 PMIs there any way of getting notified about such issues?
n
Nate
05/10/2023, 9:35 PMwe were just discussing this, we think this should be a
Crashedd
Deceivious
05/10/2023, 9:35 PMThanks. Please link the issue here as well so i can follow it.
Deceivious
05/10/2023, 9:37 PMBut the no notification issue will still exist i guess because there is no infrastucture to run
on_failureon_crashz
Zanie
05/10/2023, 9:39 PM
Yeah automations are the only way to capture that kind of failure
n
Nate
05/10/2023, 9:43 PM3 Views