Preventative Data Quality Rules

Nhập môn Chất lượng Dữ liệu

Chrissy Bloom

Head of Enterprise Data Strategy & Governance

Defining preventative rules

Preventative data quality rule: rule that stops data from loading downstream if a data quality issue is found

preventative data quality rule example with three tables where data is only loaded in the first table

Nhập môn Chất lượng Dữ liệu

Using preventative rules

  1. When the data is critical to business processes and an identified issue would cause harm if it is not immediately corrected
  2. When the issue can be easily fixed
  3. When the issue has an impact on a large number of records

three images: heart beat for criticality, a puzzle for complexity, and two intertwined arrows for impact

Nhập môn Chất lượng Dữ liệu

Implementing preventative rules

preventative data quality rule example with two tables where data does not load in the second table

Nhập môn Chất lượng Dữ liệu

Remediating issues

diagram with two example data pipelines where the first has an issue prevented and the second has the issue remediated

Nhập môn Chất lượng Dữ liệu

Detect vs prevent

diagram depicting different between detective and preventative data quality rules

Nhập môn Chất lượng Dữ liệu

Let's practice!

Nhập môn Chất lượng Dữ liệu

Preparing Video For Download...