Supervised Multiclass Classification Algorithm

A Supervised Multiclass Classification Algorithm is a supervised classification algorithm that is a multiclass classification algorithm which can be implemented by a supervised multiclass classification system (to solve a supervised multiclass classification task).

• AKA: Supervised Multinomial Prediction Method.
• Context:
  • It can range from being an Model-based Supervised Multiclass Classification Algorithm to being an Instance-based Supervised Multiclass Classification Algorithm.
  • It can range from being a Single-Pass Supervised Multiclass Classification Algorithm to being an Iterative Supervised Multiclass Classification Algorithm.
  • It can range from being a Fully-Supervised Multiclass Classification Algorithm to being an Semi-Supervised Multiclass Classification Algorithm.
  • It can range from being an Imbalanced Multiclass Supervised Classification Algorithm to being a Balanced.
  • It can be susceptible to the Quantity of Target Classes.
  • It can range from being a Single-Algorithm Multiclass Supervised Classifier to being a Binary-based Multiclass Supervised Classifier (such as a one-vs-all supervised classifier).
  • It can be used as a Supervised Graph Link Prediction Algorithm.
• Example(s):
  • One-vs-All Supervised Multiclass Classification Algorithm.
  • All-vs-All Supervised Multiclass Classification Algorithm.
  • a Multinomial Logistic Regression Algorithm.
  • a Multinomial Naive Bayes Algorithm.
  • …
• Counter-Example(s):
  • an Unsupervised Multiclass Classification Algorithm.
  • a Binary Supervised Classification Algorithm.
  • a Multinomial Regression Algorithm.
  • a Supervised Multi-Label Classification Algorithm.
• See: Classification Algorithm.

---

---

References

2009

• (Rifkin, 2009) ⇒ Ryan Rifkin. (2009). “Multiclass Classification.” In: MIT Course, 9.520: Statistical Learning Theory and Applications, Spring 2009.
  • QUOTE: OVA and AVA are so simple that many people invented them independently. It’s hard to write papers about them. So there’s a whole cottage industry in fancy, sophisticated methods for multiclass classification. To the best of my knowledge, choosing properly tuned regularization classifiers (RLSC, SVM) as your underlying binary classifiers and using one-vs-all (OVA) or all-vs-all (AVA) works as well as anything else you can do. If you actually have to solve a multiclass problem, I strongly urge you to simply use OVA or AVA, and not worry about anything else. The choice between OVA and AVA is largely computational.

2004

• (Rifkin & Klatau, 2004) ⇒ Ryan Rifkin, and Aldebaro Klautau. (2004). “In Defense of One-Vs-All Classification.” In: The Journal of Machine Learning Research, 5.

2002

• (Fürnkranz, 2002) ⇒ Johannes Fürnkranz. (2002). “Round Robin Classification.” In: The Journal of Machine Learning Research, 2. doi:10.1162/153244302320884605

2001

• (Crammer & Singer, 2001a) ⇒ Koby Crammer, and Yoram Singer. (2001). “On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines.” In: The Journal of Machine Learning Research, 2.

1995

• (Dietterich & Bakiri, 1995) ⇒ Thomas G. Dietterich, and Ghulum Bakiri. (1995). “Solving Multiclass Learning Problems via Error-Correcting Output Codes.” In: Journal of Artificial Intelligence Research, 2.

---