2013 AutoWEKACombinedSelectionandHyp

• (Thornton et al., 2013) ⇒ Chris Thornton, Frank Hutter, Holger H. Hoos, and Kevin Leyton-Brown. (2013). “Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms.” In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ISBN:978-1-4503-2174-7 doi:10.1145/2487575.2487629

Subject Headings:

Cited By

• http://scholar.google.com/scholar?q=%222013%22+Auto-WEKA%3A+Combined+Selection+and+Hyperparameter+Optimization+of+Classification+Algorithms
• http://dl.acm.org/citation.cfm?id=2487575.2487629&preflayout=flat#citedby

Quotes

Author Keywords

• Automatic programming; hyperparameter optimization; learning; model selection; optimization; weka

Abstract

Many different machine learning algorithms exist; taking into account each algorithm's hyperparameters, there is a staggeringly large number of possible alternatives overall. We consider the problem of simultaneously selecting a learning algorithm and setting its hyperparameters, going beyond previous work that attacks these issues separately. We show that this problem can be addressed by a fully automated approach, leveraging recent innovations in Bayesian optimization. Specifically, we consider a wide range of feature selection techniques (combining 3 search and 8 evaluator methods) and all classification approaches implemented in WEKA's standard distribution, spanning 2 ensemble methods, 10 meta-methods, 27 base classifiers, and hyperparameter settings for each classifier. On each of 21 popular datasets from the UCI repository, the KDD Cup 09, variants of the MNIST dataset and CIFAR-10, we show classification performance often much better than using standard selection and hyperparameter optimization methods. We hope that our approach will help non-expert users to more effectively identify machine learning algorithms and hyperparameter settings appropriate to their applications, and hence to achieve improved performance.

References

;

	Author	volume	Date Value	title	type	journal	titleUrl	doi	note	year
2013 AutoWEKACombinedSelectionandHyp	Chris Thornton Frank Hutter Holger H. Hoos Kevin Leyton-Brown			Auto-WEKA: Combined Selection and Hyperparameter Optimization of Classification Algorithms				10.1145/2487575.2487629		2013