Prediction Task Performance Measure

An Prediction Task Performance Measure is a performance measure for erroneous predictions.

• AKA: Error Rate Measure
• Context:
  • It can range from being a Type I Error Rate to being a Type II Error Rate.
• Counter-Example(s):
  • a Success Rate Metric.
  • a Mean absolute Error; Mean squared Error.
• See: Data Transmission, Accuracy; Confusion matrix.

---

---

References

• http://en.wikipedia.org/wiki/Bit_error_rate

2011

• (Kai Ming Ting, 2011b) ⇒ Kai Ming Ting. (2011). "Error Rate." In: (Sammut & Webb, 2011) p.331

1998

• (Kohavi & Provost, 1998) ⇒ Ron Kohavi, and Foster Provost. (1998). “Glossary of Terms." In: Machine Leanring 30(2-3).
  • Error rate: See Accuracy.

1983

• (Efron, 1983) ⇒ Bradley Efron, (1983). “Estimating the error rate of a prediction rule: improvement on cross-validation." In: Journal of the American Statistical Association, 78(382). http://www.jstor.org/stable/2288636
  • QUOTE: We construct a prediction rule on the basis of some data, and then wish to estimate the error rate of this rule in classifying future observations. Cross-validation provides a nearly unbiased estimate, using only the original data. Cross-validation turns out to be related closely to the bootstrap estimate of the error rate. This article has two purposes: to understand better the theoretical basis of the prediction problem, and to investigate some related estimators, which seem to offer considerably improved estimation in small samples.

---