Hey everyone wave I m experience an issue while starting pre

Question

Hey everyone wave I m experience an issue while starting prefect through the `prefect server start` command I m using the 0 15 6 Prefect version and suddendly when I try to start the server an error occurs when hasura tries to create the pgcrypto extension on PostgreSQL This is the error ```postgres 1 | 2022 11 11 15 40 49 418 UTC 84 ERROR duplicate key value violates unique constraint pg extension name index postgres 1 | 2022 11 11 15 40 49 418 UTC 84 DETAIL Key extname = pgcrypto already exists postgres 1 | 2022 11 11 15 40 49 418 UTC 84 STATEMENT CREATE EXTENSION IF NOT EXISTS pgcrypto SCHEMA public``` It s strange because I ve used prefect until yesterday and I ve never had this issue Can anybody help me on this

Stefano Cascavilla · Answer

I m also receiving this error ```towel 1 | severity ERROR name prefect server HasuraClient message Encountered internal API exception Errno 111 Connect call failed 172 20 0 3 3000 exc info Traceback most recent call last n File prefect server src prefect server utilities exceptions py line 87 in reraise as api error n yield n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 site packages httpx client py line 1385 in post n timeout=timeout n File usr local lib python3 7 site packages httpx client py line 1148 in request n request auth=auth allow redirects=allow redirects timeout=timeout n File usr local lib python3 7 site packages httpx client py line 1169 in send n request auth=auth timeout=timeout allow redirects=allow redirects n File usr local lib python3 7 site packages httpx client py line 1196 in send handling redirects n request auth=auth timeout=timeout history=history n File usr local lib python3 7 site packages httpx client py line 1232 in send handling auth n response = await self send single request request timeout n File usr local lib python3 7 site packages httpx client py line 1269 in send single request n timeout=timeout as dict n File usr local lib python3 7 site packages httpcore async connection pool py line 153 in request n method url headers=headers stream=stream timeout=timeout n File usr local lib python3 7 site packages httpcore async connection py line 65 in request n self socket = await self open socket timeout n File usr local lib python3 7 site packages httpcore async connection py line 86 in open socket n hostname port ssl context timeout n File usr local lib python3 7 site packages httpcore backends auto py line 38 in open tcp stream n return await self backend open tcp stream hostname port ssl context timeout n File usr local lib python3 7 site packages httpcore backends asyncio py line 234 in open tcp stream n stream reader=stream reader stream writer=stream writer n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpcore exceptions py line 12 in map exceptions n raise to exc exc from None nhttpcore exceptions ConnectError Errno 111 Connect call failed 172 20 0 3 3000 ```

Zanie · Answer

Usually this occurs when multiple servers attempt to start at once

Stefano Cascavilla · Answer

< Zanie> I checked it and I don t have multiple Prefect servers trying to start

Stefano Cascavilla · Answer

These are the other error logs

Stefano Cascavilla · Answer

```towel 1 | severity ERROR name prefect server Lazarus message Unexpected error APIError Unable to complete operation An internal API error occurred exc info Traceback most recent call last n File usr local lib python3 7 site packages anyio core sockets py line 164 in try connect n stream = await asynclib connect tcp remote host remote port local address n File usr local lib python3 7 site packages anyio backends asyncio py line 1692 in connect tcp n StreamProtocol host port local addr=local addr n File usr local lib python3 7 asyncio base events py line 962 in create connection n raise exceptions 0 n File usr local lib python3 7 asyncio base events py line 949 in create connection n await self sock connect sock address n File usr local lib python3 7 asyncio selector events py line 473 in sock connect n return await fut n File usr local lib python3 7 asyncio selector events py line 503 in sock connect cb n raise OSError err f Connect call failed address nConnectionRefusedError Errno 111 Connect call failed 192 168 32 3 3000 n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File usr local lib python3 7 site packages httpcore exceptions py line 8 in map exceptions n yield n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 site packages anyio core sockets py line 222 in connect tcp n raise OSError All connection attempts failed from cause nOSError All connection attempts failed n nDuring handling of the above exception another exception occurred n nTraceback most recent call last n File usr local lib python3 7 site packages httpx transports default py line 60 in map httpcore exceptions n yield n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 site packages httpcore async connection pool py line 253 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection pool py line 237 in handle async request n response = await connection handle async request request n File usr local lib python3 7 site packages httpcore async connection py line 86 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection py line 63 in handle async request n stream = await self connect request n File usr local lib python3 7 site packages httpcore async connection py line 111 in connect n stream = await self network backend connect tcp kwargs n File usr local lib python3 7 site packages httpcore backends auto py line 30 in connect tcp n host port timeout=timeout local address=local address n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpcore exceptions py line 12 in map exceptions n raise to exc exc nhttpcore ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server utilities exceptions py line 87 in reraise as api error n yield n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 site packages httpx client py line 1855 in post n extensions=extensions n File usr local lib python3 7 site packages httpx client py line 1527 in request n return await self send request auth=auth follow redirects=follow redirects n File usr local lib python3 7 site packages httpx client py line 1618 in send n history= n File usr local lib python3 7 site packages httpx client py line 1645 in send handling auth n history=history n File usr local lib python3 7 site packages httpx client py line 1679 in send handling redirects n response = await self send single request request n File usr local lib python3 7 site packages httpx client py line 1716 in send single request n response = await transport handle async request request n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpx transports default py line 77 in map httpcore exceptions n raise mapped exc message from exc nhttpx ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server services loop service py line 60 in run n await self run once n File prefect server src prefect server services towel lazarus py line 37 in run once n return await self reschedule flow runs n File prefect server src prefect server services towel lazarus py line 89 in reschedule flow runs n limit=500 n File prefect server src prefect server database orm py line 501 in get n as box=not apply schema n File prefect server src prefect server database hasura py line 85 in execute n as box=as box n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 contextlib py line 188 in aexit n await self gen athrow typ value traceback n File prefect server src prefect server utilities exceptions py line 93 in reraise as api error n raise APIError from exc nprefect server utilities exceptions APIError Unable to complete operation An internal API error occurred ```

Stefano Cascavilla · Answer

```towel 1 | severity ERROR name prefect server Scheduler message Unexpected error APIError Unable to complete operation An internal API error occurred exc info Traceback most recent call last n File usr local lib python3 7 site packages anyio core sockets py line 164 in try connect n stream = await asynclib connect tcp remote host remote port local address n File usr local lib python3 7 site packages anyio backends asyncio py line 1692 in connect tcp n StreamProtocol host port local addr=local addr n File usr local lib python3 7 asyncio base events py line 962 in create connection n raise exceptions 0 n File usr local lib python3 7 asyncio base events py line 949 in create connection n await self sock connect sock address n File usr local lib python3 7 asyncio selector events py line 473 in sock connect n return await fut n File usr local lib python3 7 asyncio selector events py line 503 in sock connect cb n raise OSError err f Connect call failed address nConnectionRefusedError Errno 111 Connect call failed 192 168 32 3 3000 n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File usr local lib python3 7 site packages httpcore exceptions py line 8 in map exceptions n yield n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 site packages anyio core sockets py line 222 in connect tcp n raise OSError All connection attempts failed from cause nOSError All connection attempts failed n nDuring handling of the above exception another exception occurred n nTraceback most recent call last n File usr local lib python3 7 site packages httpx transports default py line 60 in map httpcore exceptions n yield n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 site packages httpcore async connection pool py line 253 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection pool py line 237 in handle async request n response = await connection handle async request request n File usr local lib python3 7 site packages httpcore async connection py line 86 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection py line 63 in handle async request n stream = await self connect request n File usr local lib python3 7 site packages httpcore async connection py line 111 in connect n stream = await self network backend connect tcp kwargs n File usr local lib python3 7 site packages httpcore backends auto py line 30 in connect tcp n host port timeout=timeout local address=local address n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpcore exceptions py line 12 in map exceptions n raise to exc exc nhttpcore ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server utilities exceptions py line 87 in reraise as api error n yield n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 site packages httpx client py line 1855 in post n extensions=extensions n File usr local lib python3 7 site packages httpx client py line 1527 in request n return await self send request auth=auth follow redirects=follow redirects n File usr local lib python3 7 site packages httpx client py line 1618 in send n history= n File usr local lib python3 7 site packages httpx client py line 1645 in send handling auth n history=history n File usr local lib python3 7 site packages httpx client py line 1679 in send handling redirects n response = await self send single request request n File usr local lib python3 7 site packages httpx client py line 1716 in send single request n response = await transport handle async request request n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpx transports default py line 77 in map httpcore exceptions n raise mapped exc message from exc nhttpx ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server services loop service py line 60 in run n await self run once n File prefect server src prefect server services towel scheduler py line 47 in run once n offset=500 iterations n File prefect server src prefect server database orm py line 501 in get n as box=not apply schema n File prefect server src prefect server database hasura py line 85 in execute n as box=as box n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 contextlib py line 188 in aexit n await self gen athrow typ value traceback n File prefect server src prefect server utilities exceptions py line 93 in reraise as api error n raise APIError from exc nprefect server utilities exceptions APIError Unable to complete operation An internal API error occurred ```

Stefano Cascavilla · Answer

```towel 1 | severity ERROR name prefect server ZombieKiller message Unexpected error APIError Unable to complete operation An internal API error occurred exc info Traceback most recent call last n File usr local lib python3 7 site packages anyio core sockets py line 164 in try connect n stream = await asynclib connect tcp remote host remote port local address n File usr local lib python3 7 site packages anyio backends asyncio py line 1692 in connect tcp n StreamProtocol host port local addr=local addr n File usr local lib python3 7 asyncio base events py line 962 in create connection n raise exceptions 0 n File usr local lib python3 7 asyncio base events py line 949 in create connection n await self sock connect sock address n File usr local lib python3 7 asyncio selector events py line 473 in sock connect n return await fut n File usr local lib python3 7 asyncio selector events py line 503 in sock connect cb n raise OSError err f Connect call failed address nConnectionRefusedError Errno 111 Connect call failed 192 168 32 3 3000 n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File usr local lib python3 7 site packages httpcore exceptions py line 8 in map exceptions n yield n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 site packages anyio core sockets py line 222 in connect tcp n raise OSError All connection attempts failed from cause nOSError All connection attempts failed n nDuring handling of the above exception another exception occurred n nTraceback most recent call last n File usr local lib python3 7 site packages httpx transports default py line 60 in map httpcore exceptions n yield n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 site packages httpcore async connection pool py line 253 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection pool py line 237 in handle async request n response = await connection handle async request request n File usr local lib python3 7 site packages httpcore async connection py line 86 in handle async request n raise exc n File usr local lib python3 7 site packages httpcore async connection py line 63 in handle async request n stream = await self connect request n File usr local lib python3 7 site packages httpcore async connection py line 111 in connect n stream = await self network backend connect tcp kwargs n File usr local lib python3 7 site packages httpcore backends auto py line 30 in connect tcp n host port timeout=timeout local address=local address n File usr local lib python3 7 site packages httpcore backends asyncio py line 112 in connect tcp n local host=local address n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpcore exceptions py line 12 in map exceptions n raise to exc exc nhttpcore ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server utilities exceptions py line 87 in reraise as api error n yield n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 site packages httpx client py line 1855 in post n extensions=extensions n File usr local lib python3 7 site packages httpx client py line 1527 in request n return await self send request auth=auth follow redirects=follow redirects n File usr local lib python3 7 site packages httpx client py line 1618 in send n history= n File usr local lib python3 7 site packages httpx client py line 1645 in send handling auth n history=history n File usr local lib python3 7 site packages httpx client py line 1679 in send handling redirects n response = await self send single request request n File usr local lib python3 7 site packages httpx client py line 1716 in send single request n response = await transport handle async request request n File usr local lib python3 7 site packages httpx transports default py line 353 in handle async request n resp = await self pool handle async request req n File usr local lib python3 7 contextlib py line 130 in exit n self gen throw type value traceback n File usr local lib python3 7 site packages httpx transports default py line 77 in map httpcore exceptions n raise mapped exc message from exc nhttpx ConnectError All connection attempts failed n nThe above exception was the direct cause of the following exception n nTraceback most recent call last n File prefect server src prefect server services loop service py line 60 in run n await self run once n File prefect server src prefect server services towel zombie killer py line 220 in run once n await self reap zombie task runs n File prefect server src prefect server services towel zombie killer py line 154 in reap zombie task runs n apply schema=False n File prefect server src prefect server database orm py line 501 in get n as box=not apply schema n File prefect server src prefect server database hasura py line 85 in execute n as box=as box n File prefect server src prefect server utilities graphql py line 64 in execute n timeout=30 n File usr local lib python3 7 contextlib py line 188 in aexit n await self gen athrow typ value traceback n File prefect server src prefect server utilities exceptions py line 93 in reraise as api error n raise APIError from exc nprefect server utilities exceptions APIError Unable to complete operation An internal API error occurred ```