https://prefect.io logo
r

Runar

05/09/2023, 9:11 AM
Hi! I would like to profile the memory consumption of my prefect flow, and I found this one but it's for prefect 1, and we're using the latest version of prefect. Can anyone recommend a good tool to profile memory (RAM) consumption over time (I'd like to plot it, or at least report peak sizes), either specifically for prefect, or some other general tool? So far I've tried mprof but it seems to be way off in reporting true memory consumption, even if I do use
--include-children
. My prefect flow calls a lot of Docker containers btw, which might be the reason that the reporting is way off.