Administering a Databricks workspace

Databricks Concepts

Kevin Barlow

Data Practitioner

Account Admin

Key Responsibilities:

Creating and managing workspaces
Enabling Unity Catalog
Managing identities
Managing the account subscription

Account Console Screenshot

Account Console

Account console screenshot

https://accounts.cloud.databricks.com/

Account Console - Workspaces

Account Console Workspaces

https://accounts.cloud.databricks.com/

Account Console - Data

Account Console Data

https://accounts.cloud.databricks.com/

Account Console - Users & Groups

Account Console Users

https://accounts.cloud.databricks.com/

Account Console - Settings

Account Console Settings

https://accounts.cloud.databricks.com/

Workspace Admin

Key Responsibilities:

Managing identities in your workspace
Creating and managing compute resources
Managing workspace features and settings

Workspace Admin Settings

Data Plane

Contains all of the customer's assets needed for computation with Databricks.

Data is stored in the customer's cloud environment
Clusters / SQL Warehouses run in customer's cloud tenant.

Databricks Data Plane

Control Plane

The portion of the platform that is managed and hosted by Databricks.

Orchestrates various background tasks in Databricks
Sends requests to Data Plane to create clusters, run jobs, etc.

Databricks Control Plane

Databricks Platform Architecture

Each cloud will have the same general options to create a workspace:

Cloud Service Provider marketplace
Account Console
Using the Accounts API with Databricks
Programmatic deployment (e.g., Terraform)

Databricks Platform Architecture

¹ https://docs.databricks.com/getting-started/overview.html

Let's review!

Databricks Concepts

Preparing Video For Download...