Binary-based Multiclass Supervised Classification Algorithm

A Binary-based Multiclass Supervised Classification Algorithm is a multiclass supervised classification algorithm that solely uses binary supervised classification algorithms.

• Context:
  • It can be applied by a Binary-based Multiclass Supervised Classification System.
  • …
• Example(s):
  • a One-vs-All Multiclass Supervised Classification Algorithm.
  • an All-vs-All Multiclass Supervised Classification Algorithm.
  • …
• Counter-Example(s):
  • a Single Machine Multiclass Supervised Classification Algorithm.
• See: Labeled Graph.

---

---

References

2007

• (Takenouchi & Ishii, 2007) ⇒ T. Takenouchi, and S. Ishii. (2007). “Multiclass Classification as a Decoding Problem.” In: Proceedings of IEEE Symposium on Foundations of Computational Intelligence (FOCI 2007). doi:10.1109/FOCI.2007.371514
  • ABSTRACT: In this article, we present a new method of multiclass classification by combining multiple binary classifiers in the context of information transmission theory. In the framework of the error correcting output coding (ECOC), a misclassification of each binary classifier is formulated as a bit inversion with a probabilistic model. While the conventional Hamming decoding assumes the binary symmetric channel in an information transmission, the symmetric assumption is especially problematic in multiclass classification problems: for example, 1 vs R approach typically makes an asymmetric situation even if all classes contain the same number of examples. The asymmetry property corresponds to two kinds of error rate of the binary classification problem; the false positive error and the false negative error. We propose a probabilistic model which assumes an asymmetric channel having 3 inputs and 2 outputs. By the maximum likelihood estimation with the proposed probabilistic model, we can identify properties of the noisy channel according to performances of applied binary classifiers. A multiclass label and a class membership probability for an input are easily estimated by the model. Experimental studies using a synthetic dataset and datasets from UCI repository are performed and results show that the proposed method is superior to the Hamming decoding and comparative to other multiclass classification methods such as multiclass support vector machine
  • Also in 2006 in: Proceedings of Information-based Induction Sciences

2004

• (Rifkin & Klatau, 2004) ⇒ Ryan Rifkin, and Aldebaro Klautau. (2004). “In Defense of One-Vs-All Classification.” In: The Journal of Machine Learning Research, 5.

2001

• (Allwein et al., 2001) ⇒ Erin L. Allwein, Robert E. Schapire, and Yoram Singer. (2001). “Reducing Multiclass to Binary: a unifying approach for margin classifiers.” In: The Journal of Machine Learning Research, 1. doi:10.1162/15324430152733133

---