Ensuring Data Quality Standards with DevOps

DevOps Concepts

Cem Sakarya

DevOps Risk Advisor

DevOps ensures good code

 

• Most software handle data
• Good software drives high-quality data
• DevOps helps maintain high-quality in software

Data quality

 

• How trusted is the information?
• Most recent and accurate information
• Can be hard and costly to achieve
• Not all data requires the same quality
• There are many elements to Data Quality

Elements of data quality

 

 

• Elements breaks down and define Data Quality
• They should be traced and standardized

   

   

• Is the data correct in all details?
• Should be closely monitored

   

   

• How comprehensive is the data?
• Check if data is lost when it is stored in a database
• Check if data is lost when it is moved to different databases

   

   

• Consistency is about the reliability of the information
• It is also referred to as Data Integrity
• Should be closely monitored and tested

   

   

• Keeping and handling only the relevant information
• Irrelevant information wastes time and resources

   

   

• How up to date is the information?
• Old data could be replaced by more recent information
• Raw data within microservices is not used in data analysis
• Microservices talk to each other via API calls to get the most recent information
• The data within microservices should be replicated at an acceptable frequency

Let's practice!

DevOps Concepts