Hey folks, prefect 2.0 cloud user here.
Yesterday evening (CET) prefect flows started to fail with ``Server error '500 Internal Server Error'`` and after runs stopped failing ALL deployments had a pending run - and the runs stayed in pending forever.
They stayed in pending even though we have an automation which says "kill all runs staying in pending for longer than 1 hour".
I can't provide any logs, as there were none, I guess this was related to the cloud outage described above. That's fine for me, however, I have a question related to that:
Is there a way to prevent this "staying in pending forever"? We have some sensitive pipelines with concurrency 1 - so if one of the runs is in pending - all the others will wait forever.