Netflix has a security tool that changed the way businesses test for resilience called chaos monkey and it's successor chaos gorilla.
Netflix is one of the most popular tech companies of the 21st century, especially during this pandemic that has so many people sitting at home and trying to find ways to entertain themselves. They were one of the first to make online streaming for movies and tv shows so easily accessible and affordable for the everyday consumer, and put older companies like Blockbuster completely out of business. But their innovation doesn’t stop there, they took an extremely daring and creative approach to testing the fault tolerance of their servers that most companies would not be willing to try.
Rather than hoping that their servers were never hacked or failed, they decided to develop a system that would cause their servers to fail periodically and force their employees to learn how to handle these failures without losing availability for their customers. They named this project chaos monkey and it's successor chaos gorilla.
Chaos Monkey In 2010 Netflix had decided to move their system to the cloud, and in this environment hosts can be terminated and replaced at any time. To ensure that they were able to provide services at all times, netflix needed to be sure that their infrastructure could handle servers going down without losing the ability to meet the demands of their customers. To fix this issue they created chaos monkey and what Chaos Monkey does is it pseudo-randomly reboots Netflix's servers. This makes it obvious to the company whether or not they have systems that are redundant and can handle a few hosts going down at any time. Rather than planning and trying to avoid hosts going down, Netflix decided to create those uncertain conditions on purpose and ensure that they are able to handle it.