Alireza
02/14/2023, 2:04 PMMarvin
02/14/2023, 2:04 PMAlireza
02/14/2023, 2:06 PMMarvin
02/14/2023, 2:09 PMconcurrency-limit
commands, or programmatically using the OrionClient.create_concurrency_limit
, OrionClient.delete_concurrency_limit_by_tag
, and OrionClient.read_concurrency_limit_by_tag
methods. Additionally, if you need to prevent too many tasks from running simultaneously, you can use the [exponential_backoff
](/api-ref/prefect/tasks/#prefect.tasks.exponential_backoff) utility to generate a list of retry delays that correspond to an exponential backoff retry strategy. I hope this information was helpful and that it helps you solve your problem.Alireza
02/14/2023, 2:17 PMZanie
02/14/2023, 5:01 PMAlireza
02/14/2023, 8:27 PM--- Orion logging error ---
Traceback (most recent call last):
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/prefect/logging/handlers.py", line 153, in send_logs
await client.create_logs(self._pending_logs)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/prefect/client/orion.py", line 1899, in create_logs
await <http://self._client.post|self._client.post>(f"/logs/", json=serialized_logs)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/httpx/_client.py", line 1848, in post
return await self.request(
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/httpx/_client.py", line 1533, in request
return await self.send(request, auth=auth, follow_redirects=follow_redirects)
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/prefect/client/base.py", line 255, in send
response.raise_for_status()
File "/Library/Frameworks/Python.framework/Versions/3.10/lib/python3.10/site-packages/prefect/client/base.py", line 130, in raise_for_status
raise PrefectHTTPStatusError.from_httpx_error(exc) from exc.__cause__
prefect.exceptions.PrefectHTTPStatusError: Client error '429 Too Many Requests' for url '<https://api.prefect.cloud/api/accounts/.../workspaces/.../logs/>'
Response: {'detail': 'Too Many Requests'}
For more information check: <https://httpstatuses.com/429>
Worker information:
Approximate queue length: 1
Pending log batch length: 13
Pending log batch size: 5545
The log worker will attempt to send these logs again in 2.0s