Datenintegration

Datenbankdesign

Lis Sulmont

Curriculum Manager

Was ist Datenintegration?

Datenintegration kombiniert Daten aus unterschiedlichen Quellen, Formaten und Technologien, um Nutzenden eine übersetzte, einheitliche Sicht auf diese Daten zu bieten.

Beispiele für Business Cases

360-Grad-Kundenansicht
Akquisition
Altsysteme

Einheitliches Datenmodell

Database icon representing a unified data model

Datenquellen

Three data sources with no connection to the unified data model

Format der Datenquellen

Three data sources with no connections to the unified data model and with different formats

Einheitliches Datenmodellformat

Three data sources with different formats unconnected to the unified data model which is a Redshift data warehouse

Beispiel: DataCamp

Three data sources with different formats and from different departments unconnected to the unified data model which is a Redshift data warehouse

Aktualisierungsrhythmus – Vertrieb

The three data sources updating daily

Aktualisierungsrhythmus – Flugverkehr

The three data sources updating in real-time

Unterschiedliche Aktualisierungsrhythmen

The three data sources updating at different times

Ist das alles?

The three data sources connect to the unified data model

Nicht ganz

The three data sources updating daily with a big X over it

Transformationen

The three data sources being transformed to fit the unified data model

Transformation – Tools

Processing the three data sources via ETL to the unified data model

Auswahl eines Tools zur Datenintegration

Flexibel
Zuverlässig
Skalierbar

Automatisierte Tests und proaktive Warnmeldungen

ETL diagram with testing icons at each phase

Sicherheit

ETL diagram showing portions of data that should be restricted from its source to destination

Sicherheit – Anonymisierung von Kreditkarten

ETL diagram with anonymization of credit card data

Datenverwaltung – Herkunft

ETL diagram with a line representing the flow of data from its source to destination

Lass uns üben!

Datenbankdesign