2008 AnomalyPatternDetectioninCatego

• (Das et al., 2008) ⇒ Kaustav Das, Jeff Schneider, and Daniel B. Neill. (2008). “Anomaly Pattern Detection in Categorical Datasets.” In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2008). doi:10.1145/1401890.1401915

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%22Anomaly+pattern+detection+in+categorical+datasets%22+2008
• http://portal.acm.org/citation.cfm?doid=1401890.1401915&preflayout=flat#citedby

Quotes

Abstract

We propose a new method for detecting patterns of anomalies in categorical datasets. We assume that anomalies are generated by some underlying process which affects only a particular subset of the data. Our method consists of two steps: we first use a "local anomaly detector" to identify individual records with anomalous attribute values, and then detect patterns where the number of anomalous records is higher than expected. Given the set of anomalies flagged by the local anomaly detector, we search over all subsets of the data defined by any set of fixed values of a subset of the attributes, in order to detect self-similar patterns of anomalies. We wish to detect any such subset of the test data which displays a significant increase in anomalous activity as compared to the normal behavior of the system (as indicated by the training data). We perform significance testing to determine if the number of anomalies in any subset of the test data is significantly higher than expected, and propose an efficient algorithm to perform this test over all such subsets of the data. We show that this algorithm is able to accurately detect anomalous patterns in real-world hospital, container shipping and network intrusion data.

References

,

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2008 AnomalyPatternDetectioninCatego	Jeff Schneider Kaustav Das Daniel B. Neill			Anomaly Pattern Detection in Categorical Datasets				10.1145/1401890.1401915