Detective Data Quality Rules

Nhập môn Chất lượng Dữ liệu

Chrissy Bloom

Head of Enterprise Data Strategy & Governance

Detect and prevent

diagram depicting different between detective and preventative data quality rules

Defining detective data quality rule

Detective data quality rule: rule that monitors the data after it has already been loaded into the downstream target databases where it can be consumed.

diagram of three tables with a detective data quality rule example

Using detective rules

When the issue will not cause significant harm if it is not immediately corrected
When the issue is too complex to quickly remediate
When the issue has an impact on a relatively small number of records

three images: heart beat for criticality, a puzzle for complexity, and two intertwined arrows for impact

Implementing a detective rule

detective data quality rule example on three tables in a data pipeline

Remediating issues

detective data quality rule example with three tables in a data pipeline

Let's practice!

Nhập môn Chất lượng Dữ liệu