Neural network experiences between perceptrons and support vectors

After years of hesitation neural networks are now widely accepted as important tools for pattern recognition. As their characteristics differ strongly from the traditional techniques, neural networks have had a great influence on the recent developments of non-neural classifiers as well. A summary will be presented of the insights and fruits resulting from the neural network hype with an emphasis on the recently developed support vector machines.

[1]  Brian D. Ripley,et al.  Neural Networks and Related Methods for Classification , 1994 .

[2]  Sarunas Raudys,et al.  Evolution and generalization of a single neurone: : II. Complexity of statistical classifiers and sample size considerations , 1998, Neural Networks.

[3]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[4]  Robert P. W. Duin,et al.  Expected classification error of the Fisher linear classifier with pseudo-inverse covariance matrix , 1998, Pattern Recognit. Lett..

[5]  Emmanuel Viennet.  Architectures connexionnistes multi-modulaires. Application a l'analyse de scenes , 1993 .

[6]  Dick de Ridder,et al.  Shared Weights Neural Networks in Image Analysis , 1996 .

[7]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[8]  Thomas M. Cover,et al.  Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition , 1965, IEEE Trans. Electron. Comput..

[9]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[10]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[11]  Sarunas Raudys,et al.  Evolution and generalization of a single neurone: I. Single-layer perceptron as seven statistical classifiers , 1998, Neural Networks.

[12]  Huan Liu,et al.  Book review: Machine Learning, Neural and Statistical Classification Edited by D. Michie, D.J. Spiegelhalter and C.C. Taylor (Ellis Horwood Limited, 1994) , 1996, SGAR.

[13]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[14]  Robert P. W. Duin,et al.  Feature extraction in shared weights neural networksDick , 1996 .

[15]  B. D. Ripley,et al.  [Neural Networks: A Review from Statistical Perspective]: Comment , 1994 .

[16]  Robert P. W. Duin,et al.  A note on comparing classifiers , 1996, Pattern Recognit. Lett..

[17]  R. Duin.  Small sample size generalization , 1995 .