BigQuery Architecture

Introduction to BigQuery

Matt Forrest

CTO and author

Columnar data

Image showing the differences between row and columnar data storage

1 http://www.primarydigit.com/blog/-a-brief-introduction-to-column-oriented-databases
Introduction to BigQuery

Capacitor

Capacitor in the BigQuery Architecture

Introduction to BigQuery

Colossus

Colossus in the BigQuery architecture

Introduction to BigQuery

Jupiter

The Jupiter network in the BigQuery Architecutre

Introduction to BigQuery

Dremel

Dremel within the BigQuery architecture

Introduction to BigQuery

Borg

The Borg cluster management system in BigQuery

Introduction to BigQuery

Mixers, leaves, execution trees, and slots

Mixers, leaves, and execution trees in BigQuery

1 https://panoply.io/data-warehouse-guide/bigquery-architecture/
Introduction to BigQuery

Categorized architecture

Storage

  • Capacitor
  • Colossus

Compute

  • Jupiter
  • Borg

Query Execution (Dremel)

  • Mixers
  • Leaf nodes
  • Execution tree
  • Slots
Introduction to BigQuery

Let's practice!

Introduction to BigQuery

Preparing Video For Download...