Hi everyone! I'm wondering what solutions people might have implemented for dashboarding on top of prefect. We have use cases like "Flow A outputs metrics X,Y,Z, Flow B outputs metrics I,K,J", and we'd like to monitor these values over flow runs throughout the week. We've thought about three options:
• Uploading these as artifacts with specific keys, and writing a streamlit dashboard to retrieve artifacts and make summary plots
• Hooking prometheus and a push-exporter into our flows and then trying to do the graphing via Grafana cloud
• Having a simple key-value-labels table in SQLite that our flows write to and then we can do streamlit/dash with lower latency
Has anyone tried to solve a similar problem before and come across an elegant solution?