2011 ASimpleStatisticalModelandAssoc

• (Simon et al., 2011) ⇒ Gyorgy J. Simon, Vipin Kumar, and Peter W. Li. (2011). “A Simple Statistical Model and Association Rule Filtering for Classification.” In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2011) Journal. ISBN:978-1-4503-0813-7 doi:10.1145/2020408.2020550

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222011%22+A+Simple+Statistical+Model+and+Association+Rule+Filtering+for+Classification
• http://dl.acm.org/citation.cfm?id=2020408.2020550&preflayout=flat#citedby

Quotes

Author Keywords

• Algorithms; association rule mining; classification; data mining; filtering; statistical significance

Abstract

Associative classification is a predictive modeling technique that constructs a classifier based on class association rules (also known as predictive association rules (PARs). PARs are association rules where the consequence of the rule is a class label. Associative classification has gained substantial research attention because it successfully joins the benefits of association rule mining with classification. These benefits include the inherent ability of association rule mining to extract high-order interactions among the predictors - an ability that many modern classifiers lack - and also the natural interpretability of the individual PARs.

Associative classification is not without its caveats. Association rule mining often discovers a combinatorially large number of association rules, eroding the interpretability of the rule set. Extensive effort has been directed towards developing interestingness measures, which filter (predictive) association rules after they have been generated. These interestingness measures, albeit very successful at selecting interesting rules, lack two features that are highly valuable in the context of classification. First, only few of the interestingness measures are rooted in a statistical model. Given the distinction between a training and a test data set in the classification setting, the ability to make statistical inferences about the performance of the predictive classification rules on the test set is highly desirable. Second, the unfiltered set of predictive assocation rules (PARs) are often redundant, we can prove that certain PARs will not be used to construct a classification model given the presence of other PARs.

In this paper, we propose a simple statistical model towards making inferences on the test set about the various performance metrics of predictive association rules. We also derive three filtering criteria based on hypothesis testing, which are very selective (reduce the number of PARs to be considered by the classifier by several orders of magnitude), yet do not effect the performance of the classification adversely. In the case, where the classification model is constructed as a logistic model on top of the PARs, we can mathematically prove, that the filtering criteria do not significantly effect the classifier's performance. We also demonstrate empirically on three publicly available data sets that the vast reduction in the number of PARs indeed did not come at the cost of reducing the predictive performance.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2011 ASimpleStatisticalModelandAssoc	Vipin Kumar Gyorgy J. Simon Peter W. Li			A Simple Statistical Model and Association Rule Filtering for Classification				10.1145/2020408.2020550		2011