2015 EfficientOnlineEvaluationofBigD
- (Bifet et al., 2015) ⇒ Albert Bifet, Gianmarco de Francisci Morales, Jesse Read, Geoff Holmes, and Bernhard Pfahringer. (2015). “Efficient Online Evaluation of Big Data Stream Classifiers.” In: Proceedings of the 21st ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2015). ISBN:978-1-4503-3664-2 doi:10.1145/2783258.2783372
Subject Headings:
Notes
Cited By
- http://scholar.google.com/scholar?q=%222015%22+Efficient+Online+Evaluation+of+Big+Data+Stream+Classifiers
- http://dl.acm.org/citation.cfm?id=2783258.2783372&preflayout=flat#citedby
Quotes
Author Keywords
Abstract
The evaluation of classifiers in data streams is fundamental so that poorly-performing models can be identified, and either improved or replaced by better-performing models. This is an increasingly relevant and important task as stream data is generated from more sources, in real-time, in large quantities, and is now considered the largest source of big data. Both researchers and practitioners need to be able to effectively evaluate the performance of the methods they employ. However, there are major challenges for evaluation in a stream. Instances arriving in a data stream are usually time-dependent, and the underlying concept that they represent may evolve over time. Furthermore, the massive quantity of data also tends to exacerbate issues such as class imbalance. Current frameworks for evaluating streaming and online algorithms are able to give predictions in real-time, but as they use a prequential setting, they build only one model, and are thus not able to compute the statistical significance of results in real-time. In this paper we propose a new evaluation methodology for big data streams. This methodology addresses unbalanced data streams, data where change occurs on different time scales, and the question of how to split the data between training and testing, over multiple models.
References
;
Author | volume | Date Value | title | type | journal | titleUrl | doi | note | year | |
---|---|---|---|---|---|---|---|---|---|---|
2015 EfficientOnlineEvaluationofBigD | Albert Bifet Geoff Holmes Bernhard Pfahringer Gianmarco de Francisci Morales Jesse Read | Efficient Online Evaluation of Big Data Stream Classifiers | 10.1145/2783258.2783372 | 2015 |