Intro to event-based computing
Streaming Concepts
Mike Metzger
Data Engineer
Old days
- Shared access
- Batched jobs
- Programs run by operators and results returned to users
- Delays, missing results, etc
Personal computers
- Often single user
- But still behaved in a batch manner
- Computer would basically run tasks in order as provided
- GUI gave rise to event-based interactivity
Event-based processing
- Doesn't run at a specific time
- Tasks run when an event occurs
- User clicks a button
- A new file is uploaded to a directory
- Can still start a batch process
- Event-based systems wait for something to occur
Example event-based task
Web click-stream monitoring
- User activity occurs when clicking on links / components of a webpage
- The client application determines what resources are needed and requests these from a server
- The server returns the appropriate info and often logs the request
- These clicks (user events) are often stored or sent to a central location for storage and later analysis.
Let's practice!
Streaming Concepts
