Supervised inductive learning with Lotka–Volterra derived models

We present a classification algorithm built on our adaptation of the Generalized Lotka–Volterra model, well-known in mathematical ecology. The training algorithm itself consists only of computing several scalars, per each training vector, using a single global user parameter and then solving a linear system of equations. Construction of the system matrix is driven by our model and based on kernel functions. The model allows an interesting point of view of kernels’ role in the inductive learning process. We describe the model through axiomatic postulates. Finally, we present the results of the preliminary validation experiments.

[1]  A. J. Lotka,et al.  Elements of Physical Biology. , 1925, Nature.

[2]  M. Hirsch,et al.  Differential Equations, Dynamical Systems, and Linear Algebra , 1974 .

[3]  Timothy A. Davis,et al.  Direct methods for sparse linear systems , 2006, Fundamentals of algorithms.

[4]  Isabelle Guyon,et al.  Comparison of classifier methods: a case study in handwritten digit recognition , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[5]  David A. Cieslak,et al.  A framework for monitoring classifiers’ performance: when and why failure occurs? , 2009, Knowledge and Information Systems.

[6]  Ed Anderson,et al.  LAPACK Users' Guide , 1995 .

[7]  José Carlos Goulart de Siqueira,et al.  Differential Equations , 1919, Nature.

[8]  A. J. Lotka Elements of Physical Biology. , 1925, Nature.

[9]  Spiridon D. Likothanassis,et al.  Best terms: an efficient feature-selection algorithm for text categorization , 2005, Knowledge and Information Systems.

[10]  M. Wells,et al.  Variations and Fluctuations of the Number of Individuals in Animal Species living together , 2006 .

[11]  Matemática,et al.  Society for Industrial and Applied Mathematics , 2010 .

[12]  William Nick Street,et al.  Breast Cancer Diagnosis and Prognosis Via Linear Programming , 1995, Oper. Res..

[13]  Geoffrey J. McLachlan,et al.  Discriminant Analysis and Statistical Pattern Recognition: McLachlan/Discriminant Analysis & Pattern Recog , 2005 .

[14]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[15]  T. Poggio,et al.  General conditions for predictivity in learning theory , 2004, Nature.

[16]  Erik Strumbelj,et al.  Explanation and reliability of prediction models: the case of breast cancer recurrence , 2010, Knowledge and Information Systems.

[17]  Xiangyang Li,et al.  A supervised clustering algorithm for computer intrusion detection , 2005, Knowledge and Information Systems.

[18]  Yousef Saad,et al.  Iterative methods for sparse linear systems , 2003 .

[19]  Trevor Darrell,et al.  Nearest-Neighbor Methods in Learning and Vision: Theory and Practice (Neural Information Processing) , 2006 .

[20]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[21]  Jack Dongarra,et al.  LAPACK Users' Guide, 3rd ed. , 1999 .

[22]  Kurt Hornik,et al.  The support vector machine under test , 2003, Neurocomputing.

[23]  V. Volterra Variations and Fluctuations of the Number of Individuals in Animal Species living together , 1928 .

[24]  Bernhard Schölkopf,et al.  A Generalized Representer Theorem , 2001, COLT/EuroCOLT.

[25]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[26]  Nathalie Japkowicz,et al.  Boosting support vector machines for imbalanced data sets , 2008, Knowledge and Information Systems.

[27]  Stefan Wermter,et al.  Under Consideration for Publication in Knowledge and Information Systems Call Classification Using Recurrent Neural Networks, Support Vector Machines and Finite State Automata , 2022 .

[28]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[29]  T. Poggio,et al.  STABILITY RESULTS IN LEARNING THEORY , 2005 .

[30]  Tomaso Poggio,et al.  Everything old is new again: a fresh look at historical approaches in machine learning , 2002 .

[31]  André Elisseeff,et al.  Stability and Generalization , 2002, J. Mach. Learn. Res..

[32]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[33]  O. Taussky A Recurring Theorem on Determinants , 1949 .

[34]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[35]  H. E. Bell,et al.  Gershgorin's Theorem and the Zeros of Polynomials , 1965 .

[36]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.