I'm trying to upgrade the Prefect version we have ...
# ask-community
n
I'm trying to upgrade the Prefect version we have deployed in our Kubernetes cluster from
2.14.13
to
2.14.17
, but the Server goes into a crash loop with the error below. The Agent runs fine with the updated version. This is image
2.14.17-python3.9
. Any thoughts on why this might be happening?
Copy code
16:07:58.765 | DEBUG   | prefect.profiles - Using profile 'default'
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/local/lib/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/usr/local/lib/python3.9/site-packages/uvicorn/__main__.py", line 4, in <module>
    uvicorn.main()
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1157, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1078, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 1434, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.9/site-packages/click/core.py", line 783, in invoke
    return __callback(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/uvicorn/main.py", line 418, in main
    run(
  File "/usr/local/lib/python3.9/site-packages/uvicorn/main.py", line 587, in run
    server.run()
  File "/usr/local/lib/python3.9/site-packages/uvicorn/server.py", line 62, in run
    return asyncio.run(self.serve(sockets=sockets))
  File "/usr/local/lib/python3.9/asyncio/runners.py", line 44, in run
    return loop.run_until_complete(main)
  File "/usr/local/lib/python3.9/asyncio/base_events.py", line 647, in run_until_complete
    return future.result()
  File "/usr/local/lib/python3.9/site-packages/uvicorn/server.py", line 69, in serve
    config.load()
  File "/usr/local/lib/python3.9/site-packages/uvicorn/config.py", line 464, in load
    self.loaded_app = self.loaded_app()
  File "/usr/local/lib/python3.9/site-packages/prefect/server/api/server.py", line 627, in create_app
    ui_app = create_ui_app(ephemeral)
  File "/usr/local/lib/python3.9/site-packages/prefect/server/api/server.py", line 397, in create_ui_app
    create_ui_static_subpath()
  File "/usr/local/lib/python3.9/site-packages/prefect/server/api/server.py", line 372, in create_ui_static_subpath
    os.makedirs(static_dir)
  File "/usr/local/lib/python3.9/os.py", line 225, in makedirs
    mkdir(name, mode)
OSError: [Errno 30] Read-only file system: '/usr/local/lib/python3.9/site-packages/prefect/server/ui_build'
Server stopped!
b
Hi Nick, thanks for raising this. We're currently looking into this on our end. If possible, I'd recommend setting the version to
2.14.16
n
Sounds good, thank you. Though
2.14.16
seems to have the same problem
Hm, actually
2.14.15
and
2.14.14
have the same issue as well. Downgrading back to
2.14.13
still works.
a
Has there been any update on this? I'm still seeing the same problem up to
2.14.20
n
I am also still seeing the problem up through
2.14.20
z
I'm also having this issue on 2.16.3. Tried both the python 3.9 and python 3.12 images... @Andrea Armstrong what's your setup like?
@Bianca Hoch bumping since this has become blocking for us
Update: we were able to fix it by upgrading the version of the helm chart we were using to the latest version (we were in 2023.11.20 and went to latest)