Sign-up for the LightsOnData Newsletter to stay on top on monthly content, upcoming data events and discounts.
Recently I had a discussion on the question if the goal of data management would be to achieve good data quality or if data quality is an enabler for the most different business purposes. Data quality (DQ) is, in my personal opinion, an extremely interesting topic. When I started to learn about data quality more …read more
The easiest way to understand what a data catalog is to first understand its purpose. For that, let’s take a trip down the memory lane and reminisce about the days of the product catalogs. Does anyone remember the old Macy’s catalogs? It was basically a catalog that one would browse through for clothes, cooking items, …read more
When your organization depends on business intelligence reporting, you will need a high level of process automation within your DWH/BI application development. When you can build automation into your DWH development process, you will need fewer highly skilled people to perform tedious and repetitive testing processes – usually, every day. It is practical to increase …read more
Long ago I read an article about an apparently strange behavior: if you’re seeing a person looking at their watch and you immediately ask what time it is, just a small percentage can tell you the correct time. Some researches tried to investigate what’s the explanation for this apparently strange behavior. The results were quite …read more
Shift left testing is an approach to Data Warehouse (DW) / BI development where testing is performed early in the lifecycle. Shifting left refers not only to dynamic data and BI application testing- it also refers to static testing, conducting reviews and inspections, and even more unit and integration testing. In this article, we highlight: …read more
What better way to start this new century than to go over the pros and cons of the 4th Industrial Revolution. The 4th industrial revolution is a term coined by Professor Klaus Schwab. He is the founder and Executive chairman of the World Economic Forum, so he has some good credentials. He described the 4th …read more
I think that sometimes people still struggle to understand what data governance is. That’s why, when I’m talking about data governance I like to first make a reference to HR and Finance. This is usually when I’m asked what I do for work, what do I speak at conferences about, what do I create videos …read more
You probably use checklists to record and efficiently execute a wide range of daily work tasks. But if you don’t use data warehouse testing checklists for developing and monitoring your data warehouse quality assurance (QA), you’re missing an enormous boost in productivity and proficiency. Procedural data warehouse checklists serve as concrete reminders of which jobs we …read more
We are approaching winter, the days are shorter but IT’s always there, running everywhere in your mind, including at night between two dreams: Master Data Management (MDM)! For some time now, your company is working to be data-driven and your evolution in this field has made you understand that you have to go this way: …read more
Today’s Data Warehoues (DW) source data often originates from a large variety of data formats as illustrated in Figure 1. Original sources may consist of external data, reference data, business transactions, production raw data and more. The multitude of data sources each has its own methods, systems, and architectures for storing data. When working with …read more
Page [tcb_pagination_current_page] of [tcb_pagination_total_pages]
