Detective Data Quality Rules

Introduction to Data Quality

Chrissy Bloom

Head of Enterprise Data Strategy & Governance

Detect and prevent

diagram depicting different between detective and preventative data quality rules

Introduction to Data Quality

Defining detective data quality rule

Detective data quality rule: rule that monitors the data after it has already been loaded into the downstream target databases where it can be consumed.

diagram of three tables with a detective data quality rule example

Introduction to Data Quality

Using detective rules

  1. When the issue will not cause significant harm if it is not immediately corrected
  2. When the issue is too complex to quickly remediate
  3. When the issue has an impact on a relatively small number of records

three images: heart beat for criticality, a puzzle for complexity, and two intertwined arrows for impact

Introduction to Data Quality

Implementing a detective rule

detective data quality rule example on three tables in a data pipeline

Introduction to Data Quality

Remediating issues

detective data quality rule example with three tables in a data pipeline

Introduction to Data Quality

Let's practice!

Introduction to Data Quality

Preparing Video For Download...