Multiclass Pattern Recognition Extension for the New C-Mantec Constructive Neural Network Algorithm

The new C-Mantec algorithm constructs compact neural network architectures for classsification problems, incorporating new features like competition between neurons and a built-in filtering stage of noisy examples. It was originally designed for tackling two class problems and in this work the extension of the algorithm to multiclass problems is analyzed. Three different approaches are investigated for the extension of the algorithm to multi-category pattern classification tasks: One-Against-All (OAA), One-Against-One (OAO), and P-against-Q (PAQ). A set of different sizes benchmark problems is used in order to analyze the prediction accuracy of the three multi-class implemented schemes and to compare the results to those obtained using other three standard classification algorithms.

[1]  C. Lee Giles,et al.  What Size Neural Network Gives Optimal Generalization? Convergence Properties of Backpropagation , 1998 .

[2]  Leonardo Franco,et al.  Constructive Neural Networks , 2009, Constructive Neural Networks.

[3]  J. Nadal,et al.  Learning in feedforward layered networks: the tiling algorithm , 1989 .

[4]  Leonardo Franco,et al.  A New Decomposition Algorithm for Threshold Synthesis and Generalization of Boolean Functions , 2008, IEEE Transactions on Circuits and Systems I: Regular Papers.

[5]  Jihoon Yang,et al.  Constructive Neural-Network Learning Algorithms for Pattern Classification , 2000 .

[6]  F. Smieja.  Neural network constructive algorithms: Trading generalization for learning efficiency? , 1993 .

[7]  Douglas M. Hawkins,et al.  The Problem of Overfitting , 2004, J. Chem. Inf. Model..

[8]  Yi Lu Murphey,et al.  Multiclass pattern classification using neural networks , 2004, ICPR 2004.

[9]  Maria do Carmo Nicoletti,et al.  An empirical evaluation of constructive neural network algorithms in classification tasks , 2007 .

[10]  Marcus Frean,et al.  The Upstart Algorithm: A Method for Constructing and Training Feedforward Neural Networks , 1990, Neural Computation.

[11]  Lutz Prechelt,et al.  PROBEN 1 - a set of benchmarks and benchmarking rules for neural network training algorithms , 1994 .

[12]  Leonardo Franco,et al.  Neural Network Architecture Selection: Can Function Complexity Help? , 2009, Neural Processing Letters.

[13]  Yi Lu Murphey,et al.  Multi-class pattern classification using neural networks , 2007, Pattern Recognit..

[14]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .