John Kang

08/03/2022, 8:38 PM
Encountered an issue with the Agent in a Windows terminal. Just an FYI (on 2.0.2).
The above exception was the direct cause of the following exception: Traceback (most recent call last): File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\prefect\logging\", line 146, in send_logs await client.create_logs(self._pending_logs) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\prefect\", line 1859, in create_logs await"/logs/", json=serialized_logs) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1820, in post return await self.request( File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1506, in request return await self.send(request, auth=auth, follow_redirects=follow_redirects) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\prefect\", line 258, in send await super().send(*args, **kwargs) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1593, in send response = await self._send_handling_auth( File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1621, in _send_handling_auth response = await self._send_handling_redirects( File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1658, in _send_handling_redirects response = await self._send_single_request(request) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\", line 1695, in _send_single_request response = await transport.handle_async_request(request) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\_transports\", line 353, in handle_async_request resp = await self._pool.handle_async_request(req) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\", line 131, in exit self.gen.throw(type, value, traceback) File "C:\ProgramData\Anaconda3\envs\Capacity_venv\lib\site-packages\httpx\_transports\", line 77, in map_httpcore_exceptions raise mapped_exc(message) from exc httpx.ConnectError Worker information: Approximate queue length: 0 Pending log batch length: 3 Pending log batch size: 1080 The log worker will attempt to send these logs again in 2.0s 16:35:13.194 | ERROR | prefect.infrastructure.process - Process 'futuristic-echidna' exited with status code: 1
It seems intermittent as I've had a handful of runs that worked previously to this one.
Is it related to Prefect having to send too many logs back to the server?

Kevin Grismore

08/03/2022, 8:44 PM
prefect will definitely yell at you if you try to send too many logs at once

Jimmy Le

08/12/2022, 3:57 PM
I tried to map over 1000 url requests and the logger definitely didn't like it.