Abstract
The decision to devote a week or two to playing with the feature selection challenge (FSC) turned into a major effort that took up most of our time a few months. In most cases we used standard algorithms, with obvious modifications for the balanced error measure. Surprisingly enough, the naïve methods we used turned out to be among the best submissions to the FSC.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
B. Boser, I. Guyon, and V. Vapnik. Optimal margin classifiers. In In Fifth Annual Workshop on Computational Learning Theory, pages 144–152, 1992.
G.C. Cawley. Matlab support vector machine toolbox. University of East Anglia, School of Information Systems, Norwich, U.K., 2000. http://theoval.sys.uea.ac.uk/~gcc/svm/toolbox.
K. Crammer, R. Gilad-Bachrach, A. Navot, and N. Tishby. Margin analysis of the lvq algorithm. In Proceedings of the Fifteenth Annual Conference on Neural Information Processing, 2002.
K. Crammer, J.S. Kandola, and Y. Singer. Online classification on a budget. In Proceedings of the Sixteenth Annual Conference on Neural Information Processing, 2003.
Yoav Freund and Robert E. Schapire. A decision-theoretic generalization of online learning and an application to boosting. Journal of Computer and System Sciences, 55(1):119–139, 1997.
R. Gilad-Bachrach and A. Navot. MATLAB implementation of FSC submission, 2004. http://www.cs.huji.ac.il/labs/learning/code/fsc/.
T. Joachims. Transductive inference for text classification using support vector machines. In Proceedings of the Sixteenth International Conference on Machine Learning, pages 200–209, 1999.
N. Littlestone. Learning quickly when irrelevant attributes abound: A new linearthreshold algorithm. Machine Learning, 2(4):285–318, 1987.
A. Orlitsky, N.P. Santhanam, and J. Zhang. Always good turing: Asymptotically optimal probability estimation. Science, 302:427–431, 2003.
V. Vapnik. Statistical Learning Theory. Wiley, New York, NY, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Gilad-Bachrach, R., Navot, A. (2006). Margin Based Feature Selection and Infogain with Standard Classifiers. In: Guyon, I., Nikravesh, M., Gunn, S., Zadeh, L.A. (eds) Feature Extraction. Studies in Fuzziness and Soft Computing, vol 207. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-35488-8_18
Download citation
DOI: https://doi.org/10.1007/978-3-540-35488-8_18
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35487-1
Online ISBN: 978-3-540-35488-8
eBook Packages: EngineeringEngineering (R0)