One potential solutions is to use an Automations feature in Prefect Cloud, which allows you to set up notifications related to flow run state changes and work queue health. If you set a trigger of a late flow run state or an unhealthy work queue that might work.
We don’t currently show whether a worker/agent is connected but likely will in the future.