Hi - I am seeing lots of these errors over last fe...
# ask-communityj
Joshua Greenhalgh
10/03/2022, 8:42 AMHi - I am seeing lots of these errors over last few days;
Copy code
Exception raised while calling state handlers: ClientError([{'path': ['secret_value'], 'message': 'Unable to complete operation. An internal API error occurred.', 'extensions': {'code': 'API_ERROR'}}])
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/prefect/client/secrets.py", line 140, in get
value = secrets[self.name]
KeyError: 'SLACK_WEBHOOK_URL'1️⃣ 1
✅ 1
Joshua Greenhalgh
10/03/2022, 8:43 AMSomething happen with the API on the 2nd?
Joshua Greenhalgh
10/03/2022, 8:46 AMIn fact these errors have been occurring for a long while sporadicly - should I move all my secrets out of the secret storage and set them as env vars on my k8s pod?
Joshua Greenhalgh
10/03/2022, 8:52 AMOk just seen this https://prefect-community.slack.com/archives/CL09KU1K7/p1664700796681149
So I think basically means can't use the secrets backend :-(
j
Jeff Hale
10/03/2022, 11:52 AMThank you, Joshua. Sorry to hear that. The team is looking into it.
Jeff Hale
10/03/2022, 12:31 PMIt looks like the issue is resolved on our side. Are you seeing flows and tasks running ok?
Jeff Hale
10/03/2022, 1:52 PMThis morning we identified an internal issue which was impacting our database performance.
We have since resolved the issue and are continuing to monitor our systems to ensure performance returns to an optimal state.
We are updating our cloud status page as the matter progresses.
If you continue to see issues in your workflows, please share any affected flow run IDs or task run IDs.
We will report them to our engineering team, so that they can review the errors in more detail.
5 Views