https://prefect.io logo
#prefect-community
Title
# prefect-community
j

Joshua Greenhalgh

10/03/2022, 8:42 AM
Hi - I am seeing lots of these errors over last few days;
Copy code
Exception raised while calling state handlers: ClientError([{'path': ['secret_value'], 'message': 'Unable to complete operation. An internal API error occurred.', 'extensions': {'code': 'API_ERROR'}}])
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/prefect/client/secrets.py", line 140, in get
    value = secrets[self.name]
KeyError: 'SLACK_WEBHOOK_URL'
1️⃣ 1
1
Something happen with the API on the 2nd?
In fact these errors have been occurring for a long while sporadicly - should I move all my secrets out of the secret storage and set them as env vars on my k8s pod?
Ok just seen this https://prefect-community.slack.com/archives/CL09KU1K7/p1664700796681149 So I think basically means can't use the secrets backend :-(
j

Jeff Hale

10/03/2022, 11:52 AM
Thank you, Joshua. Sorry to hear that. The team is looking into it.
It looks like the issue is resolved on our side. Are you seeing flows and tasks running ok?
This morning we identified an internal issue which was impacting our database performance. We have since resolved the issue and are continuing to monitor our systems to ensure performance returns to an optimal state. We are updating our cloud status page as the matter progresses. If you continue to see issues in your workflows, please share any affected flow run IDs or task run IDs. We will report them to our engineering team, so that they can review the errors in more detail.
3 Views