Understanding Modern Data Architecture
Miller Trujillo
Senior Software Engineer
System | What type of data | Consuming use case | Tools |
---|---|---|---|
Data warehouse | Structured data, can handle semi-structured data | Analytical queries, BI/Analytics, reporting/dashboards | BigQuery, Redshift, Snowflake |
Blob storage | All type of data | ML models with video/imaging processing, archiving | S3, Cloud Storage, Azure Storage |
NoSQL database | Semi-structured data, time series | API exposure, high demand | BigTable, DataStore, DynamoDB, CosmosDB |
RDMBS | Structured data, can handle semi-structured data | Individual records consumption, API exposure, lower demand | Postgres, MySQL, Oracle |
Understanding Modern Data Architecture