No modern software engineer would be comfortable pushing code to production without testing it. So why are we comfortable pushing data to production without testing? Today I dive into data observability with Salma Bakouk, CEO and co-founder of Sifflet.
Observability is a measure of how well we can estimate the internal state of the system by looking at some of its outputs. It was first developed in control theory but it applies to all systems. For example, take the NASA mission Artemis.
Engineers delay the launch of the rocket because when they see that something is wrong. They do this to avoid a catastrophe and burn billions of dollars on the launch pad. They can do this thanks to a system that continuously monitors the state of the rocket, and helps them resolve issues….