2011 ImprovingPredictionsUsingAggreg

• (Dhurandhar, 2011) ⇒ Amit Dhurandhar. (2011). “Improving Predictions Using Aggregate Information.” In: Proceedings of the 17th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD-2011) Journal. ISBN:978-1-4503-0813-7 doi:10.1145/2020408.2020583

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222011%22+Improving+Predictions+Using+Aggregate+Information
• http://dl.acm.org/citation.cfm?id=2020408.2020583&preflayout=flat#citedby

Quotes

Author Keywords

• Algorithms; coarse to fine; general; hierarchical; regression

Abstract

In domains such as consumer products or manufacturing amongst others, we have problems that warrant the prediction of a continuous target. Besides the usual set of explanatory attributes we may also have exact (or approximate) estimates of aggregated targets, which are the sums of disjoint sets of individual targets that we are trying to predict. Hence, the question now becomes can we use these aggregated targets, which are a coarser piece of information, to improve the quality of predictions of the individual targets? In this paper, we provide a simple yet provable way of accomplishing this. In particular, given predictions from any regression model of the target on the test data, we elucidate a provable method for improving these predictions in terms of mean squared error, given exact (or accurate enough) information of the aggregated targets. These estimates of the aggregated targets may be readily available or obtained - through multilevel regression - at different levels of granularity. Based on the proof of our method we suggest a criterion for choosing the appropriate level. Moreover, in addition to estimates of the aggregated targets, if we have exact (or approximate) estimates of the mean and variance of the target distribution, then based on our general strategy we provide an optimal way of incorporating this information so as to further improve the quality of predictions of the individual targets. We then validate the results and our claims by conducting experiments on synthetic and real industrial data obtained from diverse domains.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2011 ImprovingPredictionsUsingAggreg	Amit Dhurandhar			Improving Predictions Using Aggregate Information				10.1145/2020408.2020583		2011