Observability

Comprendere la data architecture moderna

Miller Trujillo

Senior Software Engineer

What is observability?

  • Understanding the insides from the outside.
  • Data observability
    • Understand data as it moves
  • Complex distributed systems
  • Problem resolution
  • Reliability
Comprendere la data architecture moderna

Key aspects of observability: Monitoring & metrics

  • Monitoring, logging, and tracing.
  • Monitoring: Continuously check of system's status
  • Metrics: Numerical values emitted by the system's

Sample monitoring dashboard from Grafana playground

Comprendere la data architecture moderna

Key aspects of observability: Logging & tracing

logging

  • Records of events
    • Examples:
      • Information or debug messages
      • Exception stack trace
  • Audit logs
    • Who did what and when

Tracing

  • Track an specific request or element through different stages

Toy with map to exemplify tracing

Comprendere la data architecture moderna

Observability platforms

Observability platforms logos from GCP and AWS

Various observability platforms logos

Comprendere la data architecture moderna

Let's practice!

Comprendere la data architecture moderna

Preparing Video For Download...