Real-world use case: sensor data

Streaming Concepts

Mike Metzger

Data Engineer

What is sensor data?

• Automated devices that monitor some aspect of interest
  • Temperature monitors
  • Electricity usage monitors
  • Vehicle presence detection
  • Many others
• Tend to communicate with centralized services for management and data reporting
• Can range from a few sensors to millions or even billions

Connected doorbell

• Monitors primarily for doorbell presses
• Contains extra video / audio capabilities
• Allows live, remote interaction
• Can use camera / environmental sensors for additional detection capabilities

¹ C05731, CC BY-SA 4.0 [removed], via Wikimedia Commons

What are we monitoring?

• Button presses
• Movement detection
• Sound detection
• Requires more intensive interaction than just logging of events

Data handling

• How to store data
  • General event data (button press)
  • Sensor-based events (light sensor or audio pickup)
  • Raw data for later analysis
• Different services can have different SLAs, even in same product

Let's practice!

Streaming Concepts