Storage Solutions and SQL Object Creation

Data Ingestion and Semantic Models with Microsoft Fabric

Alex Kuntz

Head of Cloud Curriculum, DataCamp

Recap: OneLake, Lakehouse, and Warehouse

OneLake: Unified storage solution in Microsoft Fabric, integrated with every tenant. It eliminates data duplication and supports formats like Delta Parquet, CSV, and JSON.

Feature	Lakehouse	Warehouse
Data Type	Structured & Unstructured	Structured Only
Transformations	Notebooks, Dataflows (Gen2), Data Pipelines	Data Pipelines, Dataflows (Gen2), SQL-based transformations
SQL Endpoint	Read-only	Read and Write

OneLake in Microsoft Fabric

Connectors in Microsoft Fabric

Connectors create link between Fabric and various cloud and on-premises data sources.

Usage: Pipelines, Dataflows, Shortcuts, Semantic Models, KQL Databases, etc.
Shareable: Centralized and shareable across the organization, avoiding multiple versions.
Reusability: Once created, connections can be reused across supported items.
Functionality: Similar to Linked Services in ADF/Synapse.

Connections in Microsoft Fabric

Creating Stored Procedures in Microsoft Fabric

Stored Procedure: SQL-based objects used for executing predefined tasks.
Creation: supported in both Lakehouse and Warehouse
Pipeline Integration: Can be added to Data Pipelines using the Stored Procedure activity.

Stored Procedures in warehouse

Creating Views in Microsoft Fabric

Views: Virtual tables from SQL queries for simplified data access.
Creation: using T-SQL command or "Save as View" option in the UI.
Creation supported in both Lakehouse and Warehouse
Boost query performance by caching.

Views in warehouse

Let's practice!

Data Ingestion and Semantic Models with Microsoft Fabric