Hi , I ran a flow a couple of days ago, which runs a databricks job, and wait until it finishes. In the meanwhile it is running, the flow died within this error:

Traceback (most recent call last):
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/prefect/engine.py", line 1729, in orchestrate_task_run
    result = await call.aresult()
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/prefect/_internal/concurrency/calls.py", line 291, in aresult
    return await asyncio.wrap_future(self.future)
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/prefect/_internal/concurrency/calls.py", line 345, in _run_async
    result = await coro
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/prefect_databricks/jobs.py", line 1170, in jobs_runs_get
    response = await execute_endpoint.fn(
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/prefect_databricks/rest.py", line 134, in execute_endpoint
    response = await getattr(client, http_method)(
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1757, in get
    return await self.request(
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1530, in request
    return await self.send(request, auth=auth, follow_redirects=follow_redirects)
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1617, in send
    response = await self._send_handling_auth(
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1645, in _send_handling_auth
    response = await self._send_handling_redirects(
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1682, in _send_handling_redirects
    response = await self._send_single_request(request)
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_client.py", line 1719, in _send_single_request
    response = await transport.handle_async_request(request)
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_transports/default.py", line 353, in handle_async_request
    resp = await self._pool.handle_async_request(req)
  File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__
    self.gen.throw(type, value, traceback)
  File "/home/sgonzalez/venv/lib/python3.8/site-packages/httpx/_transports/default.py", line 77, in map_httpcore_exceptions
    raise mapped_exc(message) from exc
httpx.ConnectTimeout
07:34:11 PM
jobs_runs_get-173
prefect.task_runs
Finished in state Failed('Task run encountered an exception ConnectTimeout: ')

The databricks job still runs, but the flow had already finished.

Hi Santiago! I'm sorry you're running into this error. Since your team has dedicated support, our eng team is happy to assist with this one 🙂 I'll DM you with details about reaching out to our support team.

Hi Aimee, thanks for your fast reply.

My pleasure!