Visualization: 1. Hope is Not a Strategy (Chaos Engineering)
Chaos Monkey
Injects Failure
EC2 Instance
Terminated!
Auto-Scaler
Spins up replacement
Press enter or space to select a node. You can then use the arrow keys to move the node around. Press delete to remove it and escape to cancel.
Press enter or space to select an edge. You can then press delete to remove it or escape to cancel.
DOWNLOADING CONCEPT: 1. HOPE IS NOT A STRATEGY (CHAOS ENGINEERING)...
↳You configured auto-scaling.
↳You set up a multi-AZ database.
↳You have fallbacks.
↳But how do you *know* they work?
↳If you wait for a real outage to test your resilience, you will fail.
↳Chaos Engineering is the practice of intentionally injecting faults (killing servers, dropping network packets, spiking CPU) into a production system to prove that it survives without user impact.
↳Tools like Netflix's Chaos Monkey literally kill random production instances during business hours to ensure the automated healing mechanisms actually work.
▲ LIVE INCIDENTThe primary Redis cache node just died.
sre@arena:~/chaos-capacity
sre@arena:~$ redis-cli -h replica-node INFO replication