Attribute profiling in data warehouse

by / Monday, 31 August 2015 / Published in Billet
Attribute profiling

Attribute profiling examines values of individual data attributes and provides information about frequencies and distributions of their values. It helps to identify meaning and allowed values for an attribute.

Attribute profiling basics

Attribute profiling examines the values of individual data attributes and produces three categories of metadata for each attribute: basic aggregate statistics, frequent values, and value distribution.

Basic aggregate statistics include prevailing value type; number of Null values; minimum, maximum, average value, and other aggregate statistics. The key component of the attribute profile shows the most frequently occurring values along with their counts and percentages. Overall distribution of values is helpful for analysis of numeric and date/time attributes.

Attribute profiling basics (How to build it)

Data profiling is quite difficult, but some technologies emerged that are helpful. Many data profiling tools provide built-in functionality to collect comprehensive attribute profiles in a single pass. In absence of a tool attribute profiles can still be gathered (though somewhat less efficiently) using various aggregating queries.

Advanced attribute profiling techniques

On the surface attribute profiling tools only allow to collect profile on simple table fields. In reality same tools and approaches can be used for in-depth profiling and data analysis.

One technique is to collect profiles on data expressions. Another technique is to define conditions that filter out some of the records. A more technique is to build a complex data stream based on a query or a stored procedure.

 

Others articles

State transition model 

Timeline

Analyzing 

Mining 

Attibute

relationship 

subject 

Profiling

state-transition timeline profiling Analyzing Mining Mining Profiling relationship profiling

Subject profiling Profiling

Get Free Email Updates!

Signup now and receive an email once We publish new content.

We will never give away, trade or sell your email address. You can unsubscribe at any time.

Please follow and like us:
David-Marc Petit

David-Marc Petit

Président at DWBI Expert
David-Marc PETIT est le président de DWBI Expert Inc. Il cumule plus de 20 ans d’expérience dans des entreprises de toutes tailles et tous secteurs, sur trois continents, en tant qu’expert en intelligence d’affaires. Il a fait de sa mission la démocratisation de l’intelligence d’affaires (Business Intelligence) pour optimiser les revenus et la performance de ses clients.
David-Marc Petit
David-Marc Petit

Latest posts by David-Marc Petit (see all)

Leave a Reply

TOP

Enjoy this website? Please spread the word :)

Facebook
Facebook
Google+
Google+
http://www.dwbiexpert.com/en/attribute-profiling-in-data-warehouse/">
LinkedIn