https://prefect.io logo
Powered by
Title
b

Ben Muller

01/19/2023, 2:44 AM
prefect cloud issues? I just got some super strange notifications to our slack: 
Rendering the template exceeded the CPU, memory, or time limit.
Template source:
Flow run {{ flow.name }}/{{ flow_run.name }} entered state {{ flow_run.state.name }} at {{ flow_run.state.timestamp }}.
Flow ID: {{ flow_run.flow_id }}
Flow run ID: {{ flow_run.id }}
Flow run URL: {{ flow_run|ui_url }}
State message: {{ flow_run.state.message }}
Show less
👍 1
:hard-same: 1
✅ 1
c

Carlos Cueto

01/19/2023, 6:03 AM
I'm having the exact same issue ever since Cloud UI Notifications tab was removed and notifications were incorporated into Automations tab.
✅ 1
r

Rich Tata

01/19/2023, 11:14 AM
Same issue. I can still access the notifications tab by writing in the URL, but turning notifications off doesn't work. I continue to get notifications according to my original rules.
a

Anna Geller

01/19/2023, 12:17 PM
thanks so much for reporting that, I'll report to the team
s

scott

01/19/2023, 7:19 PM
see also https://prefect-community.slack.com/archives/C04E1CKG456/p1674088949559589?thread_ts=1674082488.111159&cid=C04E1CKG456
a

Anna Geller

01/19/2023, 8:40 PM
just FYI, this has been resolved 1h after being reported ✅
👍 2
👀 2
c

Carlos Cueto

01/19/2023, 9:53 PM
That's very great to hear. Thank you @Anna Geller!
🙌 1
Replying here to re-open this issue. I just received two email error notifications with the exact same issue. Issue came back.
s

scott

01/23/2023, 5:40 PM
Me too, just got one a few min ago
the 🐛 is back
:gratitude-thank-you: 1
a

Anna Geller

01/23/2023, 5:49 PM
reported ✅
c

Carlos Cueto

01/23/2023, 5:49 PM
Thank you
c

Chris Guidry

01/23/2023, 7:01 PM
Hi folks, thanks for reporting this, and thank you so much for the patience while we work through this. I'm tuning the sensitivity of this constraint so that don't get so many false positives. I'll be releasing this later today.
👍 3
s

scott

01/23/2023, 7:30 PM
@Chris Guidry Any thoughts on whether this is likely to keep happening? Or not likely? Or you don’t know?
c

Chris Guidry

01/23/2023, 7:45 PM
My plan is to stop this error from occurring for anyone unless they are truly doing something extreme. It seems like there's a problem with how we detect that a template is taking too long to render and that's what I'm digging into now.
s

scott

01/23/2023, 7:46 PM
Okay, thanks
c

Chris Guidry

01/23/2023, 7:46 PM
So sorry that this keeps popping up for you, my goal is to make this something you'll never have to worry about.
👍 3
Hello, folks! Thank you so much for bearing with us on this. I've released a new version of Prefect Cloud that should resolve these issues permanently. As always, please let us know if you see the problem recur, but I'm optimistic that I finally have these constraints dialed in.
:gratitude-thank-you: 1
👍 1
c

Carlos Cueto

01/24/2023, 6:21 PM
Thank you Chris. I’ll keep an eye on it. Appreciate the quick turnaround.
🙌 1
s

scott

01/24/2023, 6:25 PM
Great, thanks very much Chris
:highfive: 1
3 Views
#prefect-cloudJoin Slack
Powered by