[ SRE_ARENA ]
DISTRIBUTED TRACING

Finding the Needle in the Microservice Haystack.

Visualization: 1. The Microservice Murder Mystery (Why We Trace)
DOWNLOADING CONCEPT: 1. THE MICROSERVICE MURDER MYSTERY (WHY WE TRACE)...

↳In a traditional monolith, if a user request fails or is slow, you simply SSH into the server, tail the single application log file, and find the error stack trace.

  • ↳In a modern microservice architecture, a single user click might traverse 10 different services written in 5 different languages across 50 different servers.
  • ↳If the checkout request takes 8 seconds, whose fault is it? The Auth service? The Payment gateway? The Inventory database? You can't just grep through 50 isolated log files.
  • ↳Distributed Tracing solves this 'murder mystery' by creating a unified, visual timeline (a Gantt chart) of exactly where a request spent its time across the entire fleet.
▲ LIVE INCIDENTUsers report random 5-second delays on the checkout page. Logs show no errors.
sre@arena:~/logging-tracing
sre@arena:~$ jaeger-cli query --service checkout --min-duration 4s