Data warehouse design example

Các khái niệm về Kho dữ liệu (Data Warehouse)

Aaren Stubberfield

Data Scientist

Let's set the stage

  • A new startup company
  • Photo sharing app

An image of person photographing a scene

1 Photo by Alex Alvarado from unsplash.com
Các khái niệm về Kho dữ liệu (Data Warehouse)

Top-down, or bottoms up approach?

Considerations:

  • Vital to show business impact quickly
  • Top-down approach has a longer startup process

Decision:

  • Bottom-up approach
  • Sales data mart must be the priority
Các khái niệm về Kho dữ liệu (Data Warehouse)

Kimball - select the organizational process (step 1)

Considerations:

  • What type of customers purchase large volumes of photos?

Decision:

  • Develop customer purchases
Các khái niệm về Kho dữ liệu (Data Warehouse)

Kimball - Declare the grain (Step 2)

Considerations:

  • Data should be flexible to answer many questions
  • Selecting the lowest grain possible

Decision:

  • Tracking customer/photo purchases
Các khái niệm về Kho dữ liệu (Data Warehouse)

Kimball - Identify the dimensions (Step 3)

Considerations:

  • How do users describe the data that results from the business process?
  • Customer prioritization

Decision:

  • Customer location (country & state)
  • Date customer joined
  • Default payment method
Các khái niệm về Kho dữ liệu (Data Warehouse)

Kimball - Identify the facts (Step 4)

Considerations:

  • What are we answering?

Decision:

  • Time spent viewing photo before purchase
  • Photo cost and tax
  • Date of purchase
Các khái niệm về Kho dữ liệu (Data Warehouse)

Fact and dimensions tables

A star schema set of dimensional and a fact table

Các khái niệm về Kho dữ liệu (Data Warehouse)

On-premise or cloud implementation

Considerations:

  • We do not want upfront costs for hardware / software infrastructure
  • Small team - focus on high value activities

Decision:

  • Cloud implementation
Các khái niệm về Kho dữ liệu (Data Warehouse)

ETL or ELT implementation

Considerations:

  • Keep all data
  • Cloud implementation allows us to scale compute as needed

Decision:

  • ELT implementation
Các khái niệm về Kho dữ liệu (Data Warehouse)

Summary

  • Planning is critical
  • Tailor your approach based on the situation
Các khái niệm về Kho dữ liệu (Data Warehouse)

Let's practice!

Các khái niệm về Kho dữ liệu (Data Warehouse)

Preparing Video For Download...