DataEngineering

Another lesson we can learn from software engineers: break stuff to make it more reliable.Photo by Soheb Zaidi on UnsplashIt’s midnight in the dim and cluttered office of The New York Times currently serving as the “situation room.”A powerful surge of traffic is inevitable. During every major election, the wave would crest and crash against our overwhelmed systems before receding, allowing us to assess the damage.We had been in the cloud for years, which helped some. Our main systems would scale—our articles were always…