We were struggling with this yesterday too! My thought however was that maybe we should add the creation of notifications (similar to creation of things like blocks) to our CI/CD to some extent. It seems counter-intuitive, but at the end of the day if something happens to our machine, the notifications might be gone as well.