Is there a problem with prefect 2 cloud login at t...
# ask-communityj
Joshua Greenhalgh
07/13/2023, 1:58 PMIs there a problem with prefect 2 cloud login at the moment?
👍 3
✅ 1
👀 1
r
Raphael Perez
07/13/2023, 1:59 PMI believe so, it's down for us as well
j
Joshua Greenhalgh
07/13/2023, 1:59 PMcool thanks
c
Christopher Boyd
07/13/2023, 1:59 PMWhat issue are you seeing currently?
t
Trent Shapiro
07/13/2023, 2:00 PMTrent Shapiro
07/13/2023, 2:00 PMall workspaces gone
r
Raphael Perez
07/13/2023, 2:00 PMCannot login, both on UI and through the python cli
✅ 1
j
Joshua Greenhalgh
07/13/2023, 2:00 PMImage below and console logs too
j
John Kang
07/13/2023, 2:00 PMFor us as well
c
Christopher Boyd
07/13/2023, 2:00 PMOk thank you - give me a minute
j
John Kang
07/13/2023, 2:00 PMc
Christopher Boyd
07/13/2023, 2:00 PMhttps://prefect.status.io/ - we are currently investigating performance and logins, standby
Christopher Boyd
07/13/2023, 2:02 PMThank you , investigating
Christopher Boyd
07/13/2023, 2:03 PMCan you try again?
r
Raphael Perez
07/13/2023, 2:03 PMIt's back for me
✅ 1
z
Zachary Loertscher
07/13/2023, 2:04 PMI can log in now, but flow runs page takes ~10s to load
c
Christopher Boyd
07/13/2023, 2:04 PMUnderstood, we are still investigating performance issues
Christopher Boyd
07/13/2023, 2:04 PM🙌 3
thank you 1
j
John Kang
07/13/2023, 2:19 PMFlows aren't executing in the agent
John Kang
07/13/2023, 2:19 PM👍 1
j
Joshua Greenhalgh
07/13/2023, 2:20 PMAll my deployments have dissapeared...
Joshua Greenhalgh
07/13/2023, 2:20 PMand flows and flow runs 😞
Joshua Greenhalgh
07/13/2023, 2:22 PMblocks....work pools eek
r
Raphael Perez
07/13/2023, 2:23 PMThe issue seems to be only on the prefect UI, if you run
prefect flow lsj
Joshua Greenhalgh
07/13/2023, 2:25 PMYeah for flows...but not for deployments 😞
r
Raphael Perez
07/13/2023, 2:28 PMdeployments you can find with
prefect deployment lsj
Joshua Greenhalgh
07/13/2023, 2:29 PMI get a keyerror for deployments
Joshua Greenhalgh
07/13/2023, 2:29 PM Copy code
KeyError: UUID('570126de-6824-4a6b-9c81-24198ab8caee')
An exception occurred.Joshua Greenhalgh
07/13/2023, 2:30 PMAnyway I assume this will get sorted and if not I can recreate the deployments anyway
c
Christopher Boyd
07/13/2023, 2:30 PMThis is likely only temporary as a result of the ongoing incident - your data / deployments should not be “gone”
j
Joshua Greenhalgh
07/13/2023, 2:32 PMYeah they look to be back now 😓
m
Michael Michael
07/13/2023, 2:57 PMI think there is still a big delay with the api ? When I run a flow, the agent still shows me the following: "Submitting flow run id.... "but after that nothing happens for a while. After that the queue goes into the status unhealthy. No further logs are displayed in the agent. Does anyone else have this problem ?
c
Christopher Boyd
07/13/2023, 3:04 PMYou can enable debug logs on your agent to get more details - this issue should be resolved and back to full function, so I’d suspect your issue might be separate here?
m
Michael Michael
07/13/2023, 3:50 PMGet a similar error as @John Kang posted above.
https://prefect-community.slack.com/files/U03F9TT4YG5/F05GQ5N7GK0/image.png▾
c
Christopher Boyd
07/13/2023, 3:51 PMIs this for existing flow runs while we were experiencing issues, or new flow runs, or both ?
Christopher Boyd
07/13/2023, 3:53 PMThese look like just timeout errors , but it’s not clear what we are timing out on here , and in either scenario the api should be responsive at this time
j
John Kang
07/14/2023, 1:25 AM@Christopher Boyd It looks like it is working now. Thanks for looking into it for us.
6 Views