In the 6 weeks of my course, Data Quality Improvement at BCIT, I try to impart to them an understanding of how to ‘discover’ the instances of poor data quality in the data sets they are responsible for so that they can begin to help
In the domain of agile and data warehouse (DW) project testing, a DW Master Test Plan (MTP) is often considered an out-dated practice, even unnecessary. With this viewpoint, project teams may overlook long-standing motives and rationale for a project-wide DW MTP. A DW “Master Test
In the first evening of my 6-week course on Data Quality Improvement I try to communicate the high cost of poor data quality (PDQ) to my students. Their eyes are usually starting to close while I cover the course administrative details as for most of
An introduction to DW/ BI data quality risk assessmentsData warehouse and business intelligence (DW/ BI) projects are showered with risks – from data quality in the warehouse to analytic values in BI reports. If not addressed properly, data quality risks can bring entire projects to
The principles of data quality management are a set of fundamental beliefs, standards, rules and values that are accepted as true and can be used as a foundation for guiding an organization’s data quality management. They have been adapted from ISO 9000 principles of quality
Data is here to stay. In fact, your current data has already outlived or will most likely outlive its current systems and processes. What you need to be mindful of is that every time data goes through a data integration process, there are chances of
In the data quality line of work it is very rewarding to get to the root cause of the issue and fixing it, along with the data. More often than not, there are long lists of data quality issues to resolve, but how do you quickly
One of my favourite quality stories is when, just as W. Edwards Deming was about to begin his 4-day seminar on improving quality at a large enterprise, one of the executives scheduled to take the course came up to Deming and said that he was
Data profiling brings a lot of benefits and provides a first step into better understanding your data structure and quality. There are a few dedicated tools, but they have associated costs. What if I told you that you might already have access to a data
The importance of identifying and addressing the root cause of a data quality issue should never be overlooked. In this series of articles I will cover the most important techniques which help you uncover the root cause. This week will focus on the 5 whys, root