Hello Prefect team! I was curious about agent monitoring; do agents publish metrics? If so, how does that work? We're looking to start the hybrid model w/ cloud and wanted to see how this would work

Hey Charles, at this exact moment agents don’t publish metrics to Cloud and we’d recommend wiring up a service like Prometheus or DataDog for that purpose; that being said, we’re very interested in exposing these sorts of hooks in Cloud so it’s definitely in scope for the product. In Q2 you’ll see some changes to agent displays in the UI with better views of all the flow runs an individual agent submits, for example, and once that is in place we can begin to explore more elaborate metrics displays

Do the agents publish metrics? If not, how could we wire it up with Prometheus for example?

That depends on what metrics you’re interested in; at this moment they do not publish any metrics other than a basic healthcheck. You can query the API for flow runs submitted with a given agent ID but beyond that it would depend on what you’re hoping to gain visibility into

Thanks for the quick response Chris! Hope we can get that http server bundled with the agents to publish metrics. The code instrumentation for turning it into a Prometheus exporter is quite straightforward to be honest and it will save users much more time from doing process exporter/black box exporter etc around it. For the specific metrics to be exposed, gitlab runner provides a good example here if you want to take a look