Hi I am seeing lots of these errors over last few days ```Ex

Question

Hi I am seeing lots of these errors over last few days ```Exception raised while calling state handlers ClientError path secret value message Unable to complete operation An internal API error occurred extensions code API ERROR Traceback most recent call last File usr local lib python3 9 site packages prefect client secrets py line 140 in get value = secrets self name KeyError SLACK WEBHOOK URL ```

Joshua Greenhalgh · Answer

Something happen with the API on the 2nd

Joshua Greenhalgh · Answer

In fact these errors have been occurring for a long while sporadicly should I move all my secrets out of the secret storage and set them as env vars on my k8s pod

Joshua Greenhalgh · Answer

Ok just seen this <https prefect community slack com archives CL09KU1K7 p1664700796681149> So I think basically means can t use the secrets backend

Jeff Hale · Answer

Thank you Joshua Sorry to hear that The team is looking into it

Jeff Hale · Answer

It looks like the issue is resolved on our side Are you seeing flows and tasks running ok

Jeff Hale · Answer

This morning we identified an internal issue which was impacting our database performance We have since resolved the issue and are continuing to monitor our systems to ensure performance returns to an optimal state We are updating our <https prefect status io |cloud status> page as the matter progresses If you continue to see issues in your workflows please share any affected flow run IDs or task run IDs We will report them to our engineering team so that they can review the errors in more detail