Meta-cognitive RBF Network and its Projection Based Learning algorithm for classification problems

'Meta-cognitive Radial Basis Function Network' (McRBFN) and its 'Projection Based Learning' (PBL) algorithm for classification problems in sequential framework is proposed in this paper and is referred to as PBL-McRBFN. McRBFN is inspired by human meta-cognitive learning principles. McRBFN has two components, namely the cognitive component and the meta-cognitive component. The cognitive component is a single hidden layer radial basis function network with evolving architecture. In the cognitive component, the PBL algorithm computes the optimal output weights with least computational effort by finding analytical minima of the nonlinear energy function. The meta-cognitive component controls the learning process in the cognitive component by choosing the best learning strategy for the current sample and adapts the learning strategies by implementing self-regulation. In addition, sample overlapping conditions are considered for proper initialization of new hidden neurons, thus minimizes the misclassification. The interaction of cognitive component and meta-cognitive component address the what-to-learn, when-to-learn and how-to-learn human learning principles efficiently. The performance of the PBL-McRBFN is evaluated using a set of benchmark classification problems from UCI machine learning repository and two practical problems, viz., the acoustic emission signal classification and the mammogram for cancer classification. The statistical performance evaluation on these problems has proven the superior performance of PBL-McRBFN classifier over results reported in the literature.

[1]  Narasimhan Sundararajan,et al.  Risk-sensitive loss functions for sparse multi-category classification problems , 2008, Inf. Sci..

[2]  V. Mani,et al.  Acoustic emmision signal classiefiation using fuzzy C-means clustering - Neural Information Processing, 2002. ICONIP '02. Proceedings of the 9th International Conference o , 2004 .

[3]  Sheng Liu,et al.  Mammographic mass detection by vicinal support vector machine , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[4]  Nikola K. Kasabov,et al.  Evolving fuzzy neural networks for supervised/unsupervised online knowledge-based learning , 2001, IEEE Trans. Syst. Man Cybern. Part B.

[5]  Goutam Saha,et al.  In search of an optimization technique for Artificial Neural Network to classify abnormal heart sounds , 2009, Appl. Soft Comput..

[6]  Y Lu,et al.  A Sequential Learning Scheme for Function Approximation Using Minimal Radial Basis Function Neural Networks , 1997, Neural Computation.

[7]  Sundaram Suresh,et al.  A meta-cognitive sequential learning algorithm for neuro-fuzzy inference system , 2012, Appl. Soft Comput..

[8]  Francis F. Li,et al.  A neural network model for speech intelligibility quantification , 2007, Appl. Soft Comput..

[9]  Sundaram Suresh,et al.  Metacognitive Learning in a Fully Complex-Valued Radial Basis Function Neural Network , 2012, Neural Computation.

[10]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[11]  Tong Zhang.  Statistical behavior and consistency of classification methods based on convex risk minimization , 2003 .

[12]  O. J. Dunn.  Multiple Comparisons among Means , 1961 .

[13]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[14]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[15]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[16]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  M. Shamim Khan,et al.  Web document clustering using a hybrid neural network , 2004, Appl. Soft Comput..

[18]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[19]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[20]  Heiko Hoffmann,et al.  Kernel PCA for novelty detection , 2007, Pattern Recognit..

[21]  R. Venkatesh Babu,et al.  No-reference image quality assessment using modified extreme learning machine classifier , 2009, Appl. Soft Comput..

[22]  R. Iman,et al.  Approximations of the critical region of the fbietkan statistic , 1980 .

[23]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[24]  Sundaram Suresh,et al.  Meta-cognitive Neural Network for classification problems in a sequential learning framework , 2012, Neurocomputing.

[25]  Narasimhan Sundararajan,et al.  A sequential multi-category classifier using radial basis function networks , 2008, Neurocomputing.

[26]  Padmini Srinivasan,et al.  Hierarchical Text Categorization Using Neural Networks , 2004, Information Retrieval.

[27]  Sundaram Suresh,et al.  Alzheimer's disease detection using a Projection Based Learning Meta-cognitive RBF Network , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[28]  W. P. Rivers.  Autonomy at All Costs: An Ethnography of Metacognitive Self-Assessment and Self-Management among Experienced Language Learners. , 2001 .

[29]  Sundaram Suresh,et al.  A projection based learning in Meta-cognitive Radial Basis Function Network for classification problems , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[30]  John C. Platt.  A Resource-Allocating Network for Function Interpolation , 1991, Neural Computation.

[31]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[32]  Vadlamani Ravi,et al.  Threshold accepting trained principal component neural network and feature subset selection: Application to bankruptcy prediction in banks , 2008, Appl. Soft Comput..

[33]  T. O. Nelson.  Metamemory: A Theoretical Framework and New Findings , 1990 .

[34]  Hongming Zhou,et al.  Optimization method based extreme learning machine for classification , 2010, Neurocomputing.

[35]  H. J. Kim,et al.  A sequential learning algorithm for self-adaptive resource allocation network classifier , 2010, Neurocomputing.

[36]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[37]  Sundaram Suresh,et al.  A Projection Based Learning Meta-cognitive RBF Network Classifier for Effective Diagnosis of Parkinson's Disease , 2012, ISNN.

[38]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[39]  Amparo Alonso-Betanzos,et al.  A Very Fast Learning Method for Neural Networks Based on Sensitivity Analysis , 2006, J. Mach. Learn. Res..

[40]  Sundaram Suresh,et al.  A meta-cognitive learning algorithm for a Fully Complex-valued Relaxation Network , 2012, Neural Networks.

[41]  Michael T. Cox.  Metacognition in computation: A selected research review , 2005, Artif. Intell..

[42]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[43]  Randy M. Isaacson,et al.  Metacognitive Knowledge Monitoring and Self-Regulated Learning: Academic Success and Reflections on Learning. , 2006 .

[44]  Amparo Alonso-Betanzos,et al.  A Global Optimum Approach for One-Layer Neural Networks , 2002, Neural Computation.

[45]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[46]  Narasimhan Sundararajan,et al.  A Sequential Learning Algorithm for Complex-Valued Self-Regulating Resource Allocation Network-CSRAN , 2011, IEEE Transactions on Neural Networks.

[47]  Sundaram Suresh,et al.  Parkinson's disease prediction using gene expression - A projection based learning meta-cognitive neural classifier approach , 2013, Expert Syst. Appl..

[48]  Sundaram Suresh,et al.  Lift coefficient prediction at high angle of attack using recurrent neural network , 2003 .