Data Profiling Task

A Data Profiling Task is a data analysis task that examines the data available in an existing data source.

• Context:
  • It can support a Data Mining Task.
• See: Descriptive Statistics, Data Quality, Data Integration, Master Data Management, Data Governance, Descriptive Statistics.

---

---

References

2015

• (Wikipedia, 2015) ⇒ http://en.wikipedia.org/wiki/data_profiling Retrieved:2015-1-11.
  • Data profiling is the process of examining the data available in an existing data source (e.g. a database or a file) and collecting statistics and information about that data. The purpose of these statistics may be to:
    1. Find out whether existing data can easily be used for other purposes
    2. Improve the ability to search the data by tagging it with keywords, descriptions, or assigning it to a category
    3. Give metrics on data quality including whether the data conforms to particular standards or patterns
    4. Assess the risk involved in integrating data for new applications, including the challenges of joins.
    5. Assess whether metadata accurately describes the actual values in the source database
    6. Understanding data challenges early in any data intensive project, so that late project surprises are avoided. Finding data problems late in the project can lead to delays and cost overruns.
    7. Have an enterprise view of all data, for uses such as master data management where key data is needed, or data governance for improving data quality.

---