Jars
03/09/2023, 6:12 PMrequests.exceptions.ConnectionError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f9ab3f9f4e0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
jawnsy
03/09/2023, 6:30 PMJars
03/09/2023, 6:32 PMjawnsy
03/09/2023, 6:33 PMnicholas
03/09/2023, 8:03 PMJars
03/09/2023, 8:04 PMChris White
03/09/2023, 10:22 PMJars
03/09/2023, 11:22 PMBrett
03/10/2023, 1:37 PMjawnsy
03/10/2023, 1:40 PMBrett
03/10/2023, 1:41 PMurllib3.exceptions.MaxRetryError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7ff92db43370>: Failed to establish a new connection: [Errno 101] Network is unreachable'))
Could this have been because of the CSP as well?jawnsy
03/10/2023, 2:08 PMBrett
03/10/2023, 2:11 PM[2023-03-09 16:30:39+0000] INFO - prefect.CloudTaskRunner | Task 'update_stop_on_failure': Finished task run for task with final state: 'Pending'
/usr/local/lib/python3.8/site-packages/prefect/executors/dask.py:314: RuntimeWarning: coroutine 'rpc.close_rpc' was never awaited
scheduler_comm.close_rpc()
RuntimeWarning: Enable tracemalloc to get the object allocation traceback
[2023-03-09 16:30:40+0000] INFO - prefect.CloudFlowRunner | Flow run RUNNING: terminal tasks are incomplete.
jawnsy
03/10/2023, 2:15 PMBrett
03/10/2023, 2:16 PMjawnsy
03/10/2023, 2:20 PMBrett
03/10/2023, 2:28 PMJars
03/10/2023, 2:34 PMrequests.exceptions.ConnectionError: HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Max retries exceeded with url: /graphql (Caused by ReadTimeoutError("HTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Read timed out. (read timeout=15)"))
It is usually resolved with a retry after five minutes. It's happened to multiple team members running independent workstations, so no sure about DNS.jawnsy
03/10/2023, 2:35 PMBrett
03/10/2023, 2:35 PM/usr/local/lib/python3.8/site-packages/prefect/executors/dask.py:314: RuntimeWarning: coroutine 'rpc.close_rpc' was never awaited
scheduler_comm.close_rpc()From the actual pod logs just before it got removed.
jawnsy
03/10/2023, 5:58 PMBrett
03/10/2023, 7:26 PMjawnsy
03/13/2023, 6:19 PMBrett
03/14/2023, 1:39 PMalex
03/16/2023, 4:38 PMBrett
03/22/2023, 6:25 PMjawnsy
03/22/2023, 8:40 PMChris White
03/22/2023, 9:12 PMBrett
03/23/2023, 5:28 PMJars
05/19/2023, 4:20 PMHTTPSConnectionPool(host='<http://api.prefect.io|api.prefect.io>', port=443): Read timed out.
Is there any request or response ID that we can correlate? What kind of information would you require to look-up this request on the server side? project/flow/image names?jawnsy
05/19/2023, 6:29 PM