Is there a way to see what agents are polling a prefect queue for flow runs?

Not yet, but we are aware that this is an important feature request -- to stay up to date on that, I recommend following #announcements and release notes