Skip to main content

Support Vector Machine

  • Reference work entry
  • First Online:
Encyclopedia of Biometrics

Synonyms

Margin classifier; Maximum margin classifier; Optimal hyperplane SVM

Definition

Support vector machines (SVMs) are particular linear classifiers which are based on the margin maximization principle. They perform structural risk minimization, which improves the complexity of the classifier with the aim of achieving excellent generalization performance. The SVM accomplishes the classification task by constructing, in a higher dimensional space, the hyperplane that optimally separates the data into two categories.

Introduction

Considering a two-category classification problem, a linear classifier separates the space, with a hyperplane, into two regions, each of which is also called a class. Before the creation of SVMs, the popular algorithm for determining the parameters of a linear classifier was a single-neuron perceptron. The perceptron algorithm uses an updating rule to generate a separating surface for a two-class problem. The procedure is guaranteed to converge when the...

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 899.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. V. Vapnik, Statistical Learning Theory (Wiley, New York, 1998)

    MATH  Google Scholar 

  2. B. E. Boser, I. Guyon, V. Vapnik, A Training Algorithm for Optimal Margin Classifiers, in Proceedings of the 5th Annual Workshop on Computational Learning Theory (COLT’92), ed. by D. Haussler, (ACM Press, Pittsburgh, PA, USA, 1992), pp. 144–152

    Google Scholar 

  3. B. Scholkopf, A. Smola, Learning with Kernels (MIT, Cambridge, 2002)

    Google Scholar 

  4. N. Cristianini, J. Shawe-Taylor, An Introduction to Support Vector Machines (Cambridge University Press, Cambridge/New York, 2000)

    Google Scholar 

  5. T. Joachims, Making large-scale support vector machine learning practical, in Advances in Kernel Methods: Support Vector Machines, ed. by B. Scholkopf, C.J.C. Burges, A.J. Smola (MIT, Cambridge, 1998)

    Google Scholar 

  6. O. Chapelle, V. Vapnik, Model selection for support vector machines, in Advances in Neural Information Processing Systems, Denver, 1999

    Google Scholar 

  7. N.E. Ayat, M. Cheriet, C. Suen, Automatic model selection for the optimization of the SVM kernels. Pattern Recognit. 38(9), 1733–1745 (2005)

    Google Scholar 

  8. M.M. Adankon, M. Cheriet, Optimizing resources in model selection for support vector machines. Pattern Recognit. 40(3), 953–963 (2007)

    MATH  Google Scholar 

  9. M.M. Adankon, M. Cheriet, New formulation of SVM for model selection, in International Joint Conference in Neural Networks 2006, Vancouver (IEEE, 2006), pp. 3566–3573

    Google Scholar 

  10. J.A.K. Suykens, T. Van Gestel, J. De Brabanter, B. De Moor, J. Vandewalle, Least Squares Support Vector Machines (World Scientific, Singapore, 2002)

    MATH  Google Scholar 

  11. G.C. Cawley, N.L.C. Talbot, Fast exact leave-one-out cross-validation of sparse least-squares support vector machines. Neural Netw. 17, 1467–1475 (2004)

    MATH  Google Scholar 

  12. M.M. Adankon, M. Cheriet, Model selection for the LS-SVM. Application to handwriting recognition. Pattern Recognit. 42(11), 3264–3270 (2009)

    MATH  Google Scholar 

  13. M.M. Adankon, M. Cheriet, A. Biem, Semisupervised learning using Bayesian interpretation: application to LS-SVM. IEEE Trans. Neural Netw. 22(4), 513–524 (2011)

    Google Scholar 

  14. K. Roy, P. Bhattacharya, Iris recognition using support vector machine, in APR International Conference on Biometric Authentication (ICBA), Hong Kong, Jan 2006. Springer Lecture Note Series in Computer Science (LNCS), vol. 3882, 2006, pp. 486–492

    Google Scholar 

  15. Y. Yao, G. Luca Marcialis, M. Pontil, P. Frasconi, F. Roli, Combining flat and structured representations for fingerprint classification with recursive neural networks and support vector machines. Pattern Recognit. Comput. Sci. 36(2), 397–406 (2003)

    Google Scholar 

  16. N. Matic, I. Guyon, J. Denker, V. Vapnik, Writer adaptation for on-line handwritten character recognition, in Second International Conference on Pattern Recognition and Document Analysis, Tsukuba (IEEE, 1993), pp. 187–191

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer Science+Business Media New York

About this entry

Cite this entry

Adankon, M.M., Cheriet, M. (2015). Support Vector Machine. In: Li, S.Z., Jain, A.K. (eds) Encyclopedia of Biometrics. Springer, Boston, MA. https://doi.org/10.1007/978-1-4899-7488-4_299

Download citation

Publish with us

Policies and ethics