Hi, we are experiencing random errors from prefect cloud while running a flows. We are reading the secrets and have the following error:

File "/usr/local/lib/python3.9/site-packages/prefect/client/secrets.py", line 148, in get
    result = self.client.graphql(
  File "/usr/local/lib/python3.9/site-packages/prefect/client/client.py", line 473, in graphql
    raise ClientError(result["errors"])
prefect.exceptions.ClientError: [{'path': ['secret_value'], 'message': 'An unknown error occurred.', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}]

Server is randomly returning 500 error. It's working 9/10 times, however, i would expect this to work 10/10 so we don't need to restart flows manually. Has anybody experienced the same problem?

We did indeed have a reported issue about this but we addressed this in the most recent 1.0 release - specifically when this happens, after upgrading you should see API_ERROR rather than INTERNAL_SERVER_ERROR and we automatically retry on API_ERROR so upgrading your Prefect version may fix your issue.

This should be resolved without any changes to your code version since the error type has been changed in Prefect Cloud itself.