hi team im facing this issue can anyone help i ran the command inside prefect-server prefect agent start -q genome and im getting below issue puneet@IN-3D0D5S3:/mnt/c/Users/puneetmakhija$ docker exec -it 2f bash root@2f799ae846f9:/opt/prefect# prefect agent start -q genome Starting v2.11.5 agent connected to http://localhost:4200/api... _ _ _ _ _ _ _____ _ _ _ _ _ _____ | _ \ _ \ __| __| __/ _| _| /_\ / __| _| \| | _| | _/ / _|| _|| | (_ | | / _ \ (_ | _|| .` | | | |_| |_|_\___|_| |___\___| |_| /_/ \_\___|___|_|\_| |_| Agent started! Looking for work from queue(s): genome... 104723.891 | INFO | prefect.agent - Submitting flow run '85cb9217-0302-4fa1-a51c-2d324acbc4ea' 104723.980 | INFO | prefect.infrastructure.process - Opening process 'poll-model-experiment-b125'... 104723.993 | INFO | prefect.agent - Completed submission of flow run '85cb9217-0302-4fa1-a51c-2d324acbc4ea' <frozen runpy>128 RuntimeWarning: 'prefect.engine' found in sys.modules after import of package 'prefect', but prior to execution of 'prefect.engine'; this may result in unpredictable behaviour 104726.460 | INFO | Flow run 'poll-model-experiment-b125' - Downloading flow code from storage at '' 104814.767 | ERROR | Flow run 'poll-model-experiment-b125' - Flow could not be retrieved from deployment. Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1345, in _create_direct_connection hosts = await self._resolve_host(host, port, traces=traces) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 989, in _resolve_host return await asyncio.shield(resolved_host_task) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1020, in _resolve_host_with_throttle addrs = await self._resolver.resolve(host, port, family=self._family) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/resolver.py", line 36, in resolve infos = await self._loop.getaddrinfo( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/asyncio/base_events.py", line 867, in getaddrinfo return await self.run_in_executor( ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/concurrent/futures/thread.py", line 58, in run result = self.fn(*self.args, **self.kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/socket.py", line 962, in getaddrinfo for res in _socket.getaddrinfo(host, port, family, type, proto, flags): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ socket.gaierror: [Errno -3] Temporary failure in name resolution The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/aiobotocore/httpsession.py", line 178, in send response = await self._session.request( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/client.py", line 696, in _request conn = await self._connector.connect( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 544, in connect proto = await self._create_connection(req, traces, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1050, in _create_connection _, proto = await self._create_direct_connection(req, traces, timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiohttp/connector.py", line 1351, in _create_direct_connection raise ClientConnectorDNSError(req.connection_key, exc) from exc aiohttp.client_exceptions.ClientConnectorDNSError: Cannot connect to host genome-workflows.s3.amazonaws.com:443 ssl:default [Temporary failure in name resolution] During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/prefect/engine.py", line 394, in retrieve_flow_then_begin_flow_run flow = await load_flow_from_flow_run(flow_run, client=client) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/prefect/client/utilities.py", line 51, in with_injected_client return await fn(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/prefect/deployments/deployments.py", line 202, in load_flow_from_flow_run await storage_block.get_directory(from_path=deployment.path, local_path=".") File "/usr/local/lib/python3.11/site-packages/prefect/filesystems.py", line 494, in get_directory return await self.filesystem.get_directory( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/prefect/filesystems.py", line 337, in get_directory return self.filesystem.get(from_path, local_path, recursive=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 111, in wrapper return sync(self.loop, func, *args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 96, in sync raise return_result File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 53, in _runner result[0] = await coro ^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 536, in _get rpaths = await self._expand_path(rpath, recursive=recursive) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 736, in _expand_path out = await self._expand_path([path], recursive, maxdepth) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/fsspec/asyn.py", line 754, in _expand_path rec = set(await self._find(p, maxdepth=maxdepth, withdirs=True)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/s3fs/core.py", line 718, in _find out = await self._lsdir(path, delimiter="", prefix=prefix) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/s3fs/core.py", line 646, in _lsdir async for i in it: File "/usr/local/lib/python3.11/site-packages/aiobotocore/paginate.py", line 32, in anext response = await self._make_request(current_kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/client.py", line 251, in _make_api_call http, parsed_response = await self._make_request( ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/client.py", line 271, in _make_request return await self._endpoint.make_request(operation_model, request_dict) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/endpoint.py", line 80, in _send_request while await self._needs_retry(attempts, operation_model, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/endpoint.py", line 213, in _needs_retry responses = await self._event_emitter.emit( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/hooks.py", line 50, in _emit response = await resolve_awaitable(handler(**kwargs)) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/_helpers.py", line 11, in resolve_awaitable return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/retryhandler.py", line 89, in _call if await resolve_awaitable(self._checker(**checker_kwargs)): ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/_helpers.py", line 11, in resolve_awaitable return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/retryhandler.py", line 107, in _call should_retry = await self._should_retry(attempt_number, response, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/retryhandler.py", line 138, in _should_retry return await resolve_awaitable( ^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/_helpers.py", line 11, in resolve_awaitable return await obj ^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/retryhandler.py", line 146, in _call checker(attempt_number, response, File "/usr/local/lib/python3.11/site-packages/botocore/retryhandler.py", line 231, in call return self._check_caught_exception( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/botocore/retryhandler.py", line 374, in _check_caught_exception raise caught_exception File "/usr/local/lib/python3.11/site-packages/aiobotocore/endpoint.py", line 149, in _do_get_response http_response = await self._send(request) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/endpoint.py", line 229, in _send return await self.http_session.send(request) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.11/site-packages/aiobotocore/httpsession.py", line 214, in send raise EndpointConnectionError(endpoint_url=request.url, error=e) botocore.exceptions.EndpointConnectionError: Could not connect to the endpoint URL: "https://genome-workflows.s3.amazonaws.com/?list-type=2&amp;prefix=models%2F&amp;delimiter=&amp;encoding-type=url" 104815.431 | INFO | prefect.infrastructure.process - Process 'poll-model-experiment-b125' exited cleanly.

Hi Prince! Would you mind taking your error stack trace and moving it to the 🧵 ? It'll help us keep the main channel tidy.

socket.gaierror: [Errno -3] Temporary failure in name resolution

Looks like a DNS issue