Abstract
We present a classification algorithm built on our adaptation of the Generalized Lotka–Volterra model, well-known in mathematical ecology. The training algorithm itself consists only of computing several scalars, per each training vector, using a single global user parameter and then solving a linear system of equations. Construction of the system matrix is driven by our model and based on kernel functions. The model allows an interesting point of view of kernels’ role in the inductive learning process. We describe the model through axiomatic postulates. Finally, we present the results of the preliminary validation experiments.
Similar content being viewed by others
References
Anderson E, Bai Z, Bischof C, Blackford S, Demmel J, Dongarra J, Croz JD, Greenbaum A, Hammarling S , McKenney A, Sorensen D (1999) LAPACK users’ guide, 3rd edn. Society for Industrial and Applied Mathematics, Philadelphia
Bell HE (1965) Gerschgorin’s theorem and the zeros of polynomials. Am Math Mon 72: 292–295
Asuncion A, Newman DJ (2007) UCI Machine learning repository. School of Information and Computer Science. University of California, Irvine. http://www.ics.uci.edu/~mlearn/MLRepository.html
Bottou L, Cortes C, Denker J, Drucker H, Guyon I, Jackel L, LeCun Y, Muller U, Sackinger E, Simard P, Vapnik V (1994) Comparisons of classifier methods: a case study in handwriting digit recognition. In: 12th IAPR international conference on pattern recognition, vol 2, pp 77–82, Jerusalem, Israel
Bousquet O, Elisseeff A (2002) Stability and generalization. J Mach Learn Res 2: 499–526
Chang CC, Lin CJ (2001) LIBSVM: a library for support vector machines. http://www.csie.ntu.edu.tw/~cjlin/libsvm
Cieslak D, Chawla N (2009) A framework for monitoring classifiers’ performance: when and why failure occurs?. Knowl Inform Syst 18(1): 83–108
Cortes C, Vapnik VN (1995) Support-vector networks. Mach Learn 20: 273–297
Cristianini N, Shawe-Taylor J (2000) An introduction to support vector machines, 2nd edn. Cambridge University Press, Cambridge
Davis TA (2006) Direct methods for sparse linear systems. SIAM, Philadelphia
Evgeniou T, Pontil M, Poggio T (2000) Regularization networks and support vector machines. Adv Comput Math 13(1): 1–50
Fragoudis D, Meretakis D, Likothanassis S (2005) Best terms: an efficient feature-selection algorithm for text categorization. Knowl Inform Syst 8(1): 16–33
Garfield S, Wermter S (2006) Call classification using recurrent neural networks, support vector machines and finite state automata. Knowl Inform Syst 9(2): 131–156
Hirsch M, Smale S (1974) Differential equations, dynamical systems, and linear algebra. Academic Press, New York
Li X, Ye N (2005) A supervised clustering algorithm for computer intrusion detection. Knowl Inform Syst 8(4): 498–509
Lotka AJ (1925) Elements of physical biology. Williams and Wilkins, Baltimore
Mangasarian OL, Street WN, Wolberg WH (1995) Breast cancer diagnosis and prognosis via linear programming. Oper Res 43(4): 570–577
McLachlan GJ (1992) Discriminant analysis and statistical pattern recognition. Wiley Interscience, New York
Meerschaert MM (1999) Mathematical modeling, 2nd edn. Academic Press, New York
Meyer D, Leisch F, Hornik K (2003) The support vector machine under test. Neurocomputing 55: 169–186
Poggio T, Rifkin R, Mukherjee S, Niyogi P (2004) General conditions for predictivity in learning theory. Nature 428: 419–422
Rakhlin A, Mukherjee S, Poggio T (2005) Stability results in learning theory. Anal Appl 3(4): 397–417
Rifkin RM (2002) Everything old is new again: a fresh look at historical approaches in machine learning. PhD thesis. MIT, Cambridge
Saad Y (2003) Iterative methods for sparse linear systems, 2nd edn. SIAM, Philadelphia
Schölkopf B, Herbrich R, Smola AJ (2001) A generalized representer theorem. In: Proceedings of the 14th annual conference on computational learning theory, Amsterdam, pp 416–426
Shakhnarovich G, Darrell T, Indyk P (2005) Nearest-neighbor methods in learning and vision: theory and practice. MIT Press, Cambridge
Štrumbelj E, Bosnić Z, Kononenko I, Zakotnik B, Kuhar CG (2009) Explanation and reliability of prediction models: the case of breast cancer recurrence. Knowl Inform Syst (in press)
Tikhonov AN, Arsenin VY (1977) Solutions of ill-posed problems. Winston & Sons, Washington, DC
Vapnik VN (2000) The nature of statistical learning theory. Springer, Berlin
Volterra V (1926) Variations and fluctuations of the number of individuals in animal species living together. In: Chapman RN (eds) Animal ecology. McGraw-Hill, New York, pp 409–448
Wang BX, Japkowicz N (2009) Boosting support vector machines for imbalanced data sets. Knowl Inform Syst. http://www.springerlink.com/content/73003jg256812542
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Hovsepian, K., Anselmo, P. & Mazumdar, S. Supervised inductive learning with Lotka–Volterra derived models. Knowl Inf Syst 26, 195–223 (2011). https://doi.org/10.1007/s10115-009-0280-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10115-009-0280-5