Clustered-Hybrid Multilayer Perceptron network for pattern recognition application

This paper introduces a modified version of the Hybrid Multilayer Perceptron (HMLP) network to improve the performance of the conventional HMLP network. We adopted the Clustering Algorithm from the Radial Basis Function (RBF) network architecture and incorporated it into the conventional HMLP network architecture. The modified model is called Clustered-Hybrid Multilayer Perceptron (Clustered-HMLP) network. The proposed Clustered-HMLP network architecture is trained using modified training algorithm called Clustered-Modified Recursive Prediction Error (Clustered-MRPE). The capability of the Clustered-HMLP network with Clustered-MRPE training algorithm is demonstrated using seven benchmark datasets from the University of California at Irvine (UCI) machine learning repository (i.e. Iris, Ionosphere, Pima Indian Diabetes, Wine, Lung Cancer, Hayes-Roth and Glass) and compared with the performance of other twelve classifiers reported in literature. Further, the new network is implemented to model a Transformer Fault Diagnosis System and Aggregate Shape Identification System. The results indicate that the proposed Clustered-HMLP network outperforms other eleven classifiers and provides a significant improvement to the conventional HMLP network for pattern recognition application.

[1]  Nor Ashidi Mat Isa,et al.  An automated cervical pre-cancerous diagnostic system , 2008, Artif. Intell. Medicine.

[2]  Stephen A. Billings,et al.  Generalized multiscale radial basis function networks , 2007, Neural Networks.

[3]  Chin-Pao Hung,et al.  Diagnosis of incipient faults in power transformers using CMAC neural network approach , 2004 .

[4]  Simon Kasif,et al.  A System for Induction of Oblique Decision Trees , 1994, J. Artif. Intell. Res..

[5]  M. Y. Mashor.  Hybrid multilayered perceptron networks , 2000, Int. J. Syst. Sci..

[6]  Stephen A. Billings,et al.  Recurrent radial basis function networks for adaptive noise cancellation , 1995, Neural Networks.

[7]  Sam Kash Kachigan.  Statistical Analysis: An Interdisciplinary Introduction to Univariate & Multivariate Methods , 1986 .

[8]  Hamid Mohamadi,et al.  Data mining with a simulated annealing based fuzzy classification system , 2008, Pattern Recognit..

[9]  Yong Zeng,et al.  Pseudo nearest neighbor rule for pattern classification , 2009, Expert Syst. Appl..

[10]  A. Patrikar.  Dual networks and their pattern classification properties , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Pierre Gançarski,et al.  Comparison between two coevolutionary feature weighting algorithms in clustering , 2008, Pattern Recognit..

[12]  M. Y. Mashor,et al.  An automated cervical precancerous diagnostic system , 2008 .

[13]  Halife Kodaz,et al.  Medical application of information gain based artificial immune recognition system (AIRS): Diagnosis of thyroid disease , 2009, Expert Syst. Appl..

[14]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[15]  Surendra Ranganath,et al.  Cloud basis function neural network: A modified RBF network architecture for holistic facial expression recognition , 2008, Pattern Recognit..

[16]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[17]  Nor Ashidi Mat Isa,et al.  Suitable features selection for the HMLP and MLP networks to identify the shape of aggregate , 2008 .

[18]  Shung-Yung Lung.  Efficient text independent speaker recognition with wavelet feature selection based multilayered neural network using supervised learning algorithm , 2007, Pattern Recognit..

[19]  Peter W. Eklund,et al.  A Performance Survey of Public Domain Supervised Machine Learning Algorithms , 2007 .

[20]  M. Y. Mashor.  Hybrid training algorithm for RBF Network , 2000 .

[21]  Sadik Kara,et al.  Atrial fibrillation classification with artificial neural networks , 2007, Pattern Recognit..

[22]  Mohd Yusoff Mashor.  Performance comparison between back propagation, RPE and MRPE algorithms for training MLP networks , 2000 .

[23]  F. Girosi,et al.  Networks for approximation and learning , 1990, Proc. IEEE.

[24]  Abdelhak M. Zoubir,et al.  Bootstrap techniques for signal processing , 2004 .

[25]  Novruz Allahverdi,et al.  Design of a hybrid system for the diabetes and heart diseases , 2008, Expert Syst. Appl..

[26]  Vladimir Cherkassky,et al.  Learning from Data: Concepts, Theory, and Methods , 1998 .

[27]  Fevzullah Temurtas,et al.  A comparative study on thyroid disease diagnosis using neural networks , 2009, Expert Syst. Appl..

[28]  M. Y. Mashor.  Some Properties of RBF Network with Applications to System Identification , 1999 .

[29]  Sheng Chen,et al.  Recursive hybrid algorithm for non-linear system identification using radial basis function networks , 1992 .

[30]  Héctor Pomares,et al.  Multiobjective evolutionary optimization of the size, shape, and position parameters of radial basis function networks for function approximation , 2003, IEEE Trans. Neural Networks.

[31]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[32]  John E. Moody,et al.  Fast adaptive k-means clustering: some empirical results , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[33]  Simon Haykin,et al.  Neural networks , 1994 .

[34]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1992, Math. Control. Signals Syst..

[35]  Hans Geiger,et al.  STORING AND PROCESSING INFORMATION IN CONNECTIONIST SYSTEMS , 1990 .

[36]  Lennart Ljung,et al.  Theory and Practice of Recursive Identification , 1983 .

[37]  P. Werbos,et al.  Beyond Regression : "New Tools for Prediction and Analysis in the Behavioral Sciences , 1974 .

[38]  Shen Zhang,et al.  Improved BP Neural Network for Transformer Fault Diagnosis , 2007 .

[39]  Mohammad Yusoff Mashor,et al.  Modified Recursive Prediction Error Algorithm for Training Layered Neural Network , 2003 .

[40]  Chee Peng Lim,et al.  A modified fuzzy min-max neural network with rule extraction and its application to fault detection and classification , 2008, Appl. Soft Comput..