The Databricks Data Intelligence Platform

Introduction to Databricks

Kevin Barlow

Data Analytics Practitioner

Architecture Options

Data Warehouse and Data Lake architecture

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

Birth of the Lakehouse

Data Warehouse architecture selected

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

Birth of the Lakehouse

Data Lake architecture selected

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

Birth of the Lakehouse

Data Warehouse and Data Lake architecture

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

Birth of the Lakehouse

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

The Databricks Lakehouse

The Databricks Lakehouse Platform

  • Single platform for all data workloads
  • Simplified architecture
  • Collaborative environment

Databricks Lakehouse High-Level Diagram

1 https://www.databricks.com/blog/2021/05/19/evolution-to-the-data-lakehouse.html
Introduction to Databricks

The Databricks Data Intelligence Platform

Evolution from the Lakehouse

Databricks has expanded the Lakehouse vision to create the first Data Intelligence Platform

  • Same core architecture of the Lakehouse
  • Built-in AI
  • First-class support for custom AI applications

Data Intelligence Platform Diagram

1 https://www.databricks.com/product/data-intelligence-platform
Introduction to Databricks

Databricks Architecture Benefits

Unification

  • Every use case from AI to BI
  • Benefits of data warehouse and data lake

Unified Analytics Applications

Multi-Cloud

  • Bring powerful platform to your data
  • No lock-in to a specific cloud platform

Multiple Clouds

Introduction to Databricks

Databricks Development Benefits

Collaborative

  • Every data persona
  • Ability to work in same platform in real-time

Collaborative Team

Open-Source

  • Underpinned by Apache Spark
  • Support for most popular languages (Python, R, Scala, SQL)

Open Source

Introduction to Databricks

Let's practice!

Introduction to Databricks

Preparing Video For Download...