2008 VolatileCorrelationComputationa

• (Zhou et al., 2008) ⇒ Wenjun Zhou, and Hui Xiong. (2008). “Volatile Correlation Computation: A Checkpoint View.” In: Proceedings of the 14th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2008). doi:10.1145/1401890.1401991

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%22Volatile+correlation+computation%3A+a+checkpoint+view%22+2008
• http://portal.acm.org/citation.cfm?doid=1401890.1401991&preflayout=flat#citedby

Quotes

Abstract

Recent years have witnessed increased interest in computing strongly correlated pairs in very large databases. Most previous studies have been focused on static data sets. However, in real-world applications, input data are often dynamic and must continually be updated. With such large and growing data sets, new research efforts are expected to develop an incremental solution for correlation computing. Along this line, in this paper, we propose a CHECK-POINT algorithm that can efficiently incorporate new transactions for correlation computing as they become available. Specifically, we set a checkpoint to establish a computation buffer, which can help us determine an upper bound for the correlation. This checkpoint bound can be exploited to identify a list of candidate pairs, which will be maintained and computed for correlations as new transactions are added into the database. However, if the total number of new transactions is beyond the buffer size, a new upper bound is computed by the new checkpoint and a new list of candidate pairs is identified. Experimental results on real-world data sets show that CHECK-POINT can significantly reduce the correlation computing cost in dynamic data sets and has the advantage of compacting the use of memory space.

References

,

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2008 VolatileCorrelationComputationa	Hui Xiong			Volatile Correlation Computation: A Checkpoint View				10.1145/1401890.1401991