Hi, I think there was an update to the flow run d...
# prefect-ui
p
Hi, I think there was an update to the flow run dependency graph visualization. I have a flow run with ~600 subflow. The UI is extremely sluggish, I can barely navigate. We are seeing same issue on Mac Arm/Intel + Chrome+Firefox. Is there a way to turn off the update? We are really struggling. Many thanks, Peter
โœ… 1
b
Hi Peter, Indeed there was an update made, sorry to hear you're encountering issues! Are you looking at runs in a completed state? We've definitely tested it with far more than 600 nodes (I've had 10k nodes running pretty smoothly just yesterday)
Ok, so we can reproduce this. It looks like 10k tasks are totally doable but there are performance issues with lots of subflows specifically. We're investigating.
p
Yeah we basically exclusively use subflows (technically flow-of-deployments), we have some with 2k where the page entirely crashes the tab after ~10s.
Great you can reproduce, thanks for jumping on this ๐Ÿ™‚
๐Ÿ‘ 1
b
We've identified 2 issues going on. We're working on the second one, will take a bit of time but we'll have something out today for sure.
๐Ÿ‘ 1
p
Cool, thanks for the update ๐Ÿ™‚
c
@Peter Bygrave we just released some updates that should improve your experience significantly. Can you let us know if things are running more smoothly for you?
p
Thats great! Our large flow runs now render. Thanks for the quick turn around!
๐Ÿ™Œ 1
c
Awesome, glad we were able to sort that out. Thank you for reporting!
j
Thanks for getting this fixed quick!
c
Youโ€™re welcome!
๐Ÿฆœ 1
p
Hey all, can we roll back to this a bit. When we have a parent flow with 100-200 running subflows the UI becomes extremely slow again and locking up on. At this scale only when the flow is complete we get okay performance again. This however only lasts until we have >500 completed subflows. Above this we basically become blocked. We are trying to work around this for now by having subflow-of-subflows-of-subflows, buts its getting a bit out of control.
m
I want to echo that for me even 16 subflows causes tabs to lock up.
c
Thanks for reporting back. @Peter Bygrave are the problems youโ€™re seeing all related to viewing a running flow that has a lot of sub flows? Once the flow is complete does everything return to normal? @Mike O'Connor same question. When running or just in general. If while running does the tab return to normal after the flow is complete?
m
thatโ€™s right, itโ€™s while running flows that things are struggling. Once complete things are pretty good.
thank you 1
p
Yeah whilst running is the biggest challenge
thank you 1
c
I'll see if I can carve out some time this week to address this. Thank you both for reporting!
gratitude thank you 1
๐Ÿš€ 2
Been digging into this today. I can reproduce with any flow that has a number of long running nodes (tasks or subflows). Not sure what the issue is yet but will report back once its figured out
Figured out what was going on. Here's the fix PR in the underlying graph library if you're interested. Will get this into production for cloud tomorrow and will go out to oss on Thursday. Thank you both for reporting!
๐Ÿฆœ 4
๐Ÿ™ 3
p
That is awesome, thanks for fixing and sharing the PR ๐Ÿ™‚ We will test it out this week and let you know
m
fantastic, thanks!
c
That fix is in production in cloud. I'd appreciate if you could let me know when you get a chance to test ๐Ÿ‘