In our prefect dashboard, I noticed that a work queue was "Unhealthy" and had lots of "Late" flow runs. The work queue had 20 concurrency limit and all the task in the flows in that work queue have "Task run concurrency tags" assigned.
So I checked the concurrency tag limit and noticed this one task that has been running for 10h+. The tasks usually finishes in few mins.