Analyzing profiling in data warehouse

by / Wednesday, 02 September 2015 / Published in Billet
Analyzing

Analyzing profiling results

Data profiles provide tremendous volumes of metadata and our success in ensuring data quality is directly proportional to our ability to process and understand this information and make appropriate conclusions.

One approach is to manually go through profiles, one at a time, and skip through the basics while focusing on anything unusual or unexpected. Of course nothing beats human intelligence in the ability to mine knowledge out of wheel-presented data. However, the task may prove overwhelming.

An alternative approach is to use automated algorithms to narrow down data profiles to those with information deemed of further interest. Various approaches can be used. For instance, we can automate cross-referencing valid values in data dictionary or lookup tables against frequency charts in data profiles. We can also automate search for candidate substitutes for default values. We can even write a program that will identify any distribution charts with signs of clustering. All these techniques prove useful on a large project or as a part of a toolset of a data quality professional.

Dependency profiling

Dependency profiling uses various pattern recognition techniques to find hidden relationships between attribute values.

Hierarchy profiling

Hierarchy profiling shows the relationship between parent level and children level. One parent can have some children; one child can have one and only one parent at the same time.

Hierarchy profiling result shows a department is linked to two faculties, so a break in the hierarchy exists. It will be necessary to investigate.

 

 

Others articles

State transition model 

Timeline

Analyzing 

Mining 

Attibute

relationship 

subject 

Profiling

state-transition timeline profiling Analyzing Mining Mining Profiling relationship profiling

Subject profiling Profiling

Get Free Email Updates!

Signup now and receive an email once We publish new content.

We will never give away, trade or sell your email address. You can unsubscribe at any time.

Please follow and like us:
David-Marc Petit

David-Marc Petit

Président at DWBI Expert
David-Marc PETIT est le président de DWBI Expert Inc. Il cumule plus de 20 ans d’expérience dans des entreprises de toutes tailles et tous secteurs, sur trois continents, en tant qu’expert en intelligence d’affaires. Il a fait de sa mission la démocratisation de l’intelligence d’affaires (Business Intelligence) pour optimiser les revenus et la performance de ses clients.
David-Marc Petit
David-Marc Petit

Latest posts by David-Marc Petit (see all)

Leave a Reply

TOP

Enjoy this website? Please spread the word :)

Facebook
Facebook
Google+
Google+
http://www.dwbiexpert.com/en/analyzing-profiling-in-data-warehouse/">
LinkedIn