2014 OnlineChineseRestaurantProcess

• (Liu et al., 2014) ⇒ Chien-Liang Liu, Tsung-Hsun Tsai, and Chia-Hoang Lee. (2014). “Online Chinese Restaurant Process.” In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2014) Journal. ISBN:978-1-4503-2956-9 doi:10.1145/2623330.2623636

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222014%22+Online+Chinese+Restaurant+Process
• http://dl.acm.org/citation.cfm?id=2623330.2623636&preflayout=flat#citedby

Quotes

Author Keywords

• Adaptive learning; [[chinese restaurant process; nonparametric; online computation; online learning; parameter learning

Abstract

Processing large volumes of streaming data in near-real-time is becoming increasingly important as the Internet, sensor networks and network traffic grow. Online machine learning is a typical means of dealing with streaming data, since it allows the classification model to learn one instance of data at a time. Although many online learning methods have been developed since the development of the Perceptron algorithm, existing online methods assume that the number of classes is available in advance of classification process. However, this assumption is unrealistic for large scale or streaming data sets. This work proposes an online Chinese restaurant process (CRP) algorithm, which is an online and nonparametric algorithm, to tackle this problem. This work proposes a relaxing function as part of the prior and updates the parameters with the likelihood function in terms of the consistency between the true label information and predicted result. This work presents two Gibbs sampling algorithms to perform posterior inference. In the experiments, the online CRP is applied to three massive data sets, and compared with several online learning and batch learning algorithms. One of the data sets is obtained from Wikipedia, which comprises approximately two million documents. The experimental results reveal that the proposed online CRP performs well and efficiently on massive data sets. Finally, this work proposes two methods to update the hyperparameter [math]\displaystyle{ \alpha }[/math] of the online CRP. The first method is based on the posterior distribution of [math]\displaystyle{ \alpha }[/math], and the second exploits the property of online learning, namely adapting to change, to adjust [math]\displaystyle{ \alpha }[/math] dynamically.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2014 OnlineChineseRestaurantProcess	Chien-Liang Liu Tsung-Hsun Tsai Chia-Hoang Lee			Online Chinese Restaurant Process				10.1145/2623330.2623636		2014