A Fuzzy MLP Approach for Non-linear Pattern Classification

In case of decision making problems, classification of pattern is a complex and crucial task. Pattern classification using multilayer perceptron (MLP) trained with back propagation learning becomes much complex with increase in number of layers, number of nodes and number of epochs and ultimate increases computational time (31). In this paper, an attempt has been made to use fuzzy MLP and its learning algorithm for pattern classification. The time and space complexities of the algorithm have been analyzed. A training performance comparison has been carried out between MLP and the proposed fuzzy-MLP model by considering six cases. Results are noted against different learning rates (α) ranging from 0 to 1. A new performance evaluation factor ‗convergence gain' has been introduced. It is observed that the number of epochs drastically reduced and performance increased compared to MLP. The average and minimum gain has been found to be 93% and 75% respectively. The best gain is found to be 95% and is obtained by setting the learning rate to 0.55.

[1]  Giovanni Soda,et al.  Artificial neural networks for document analysis and recognition , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Sung-Bae Cho,et al.  An improved swarm optimized functional link artificial neural network (ISO-FLANN) for classification , 2012, J. Syst. Softw..

[3]  Guoqiang Peter Zhang,et al.  Neural networks for classification: a survey , 2000, IEEE Trans. Syst. Man Cybern. Part C.

[4]  Sankar K. Pal,et al.  Knowledge-based fuzzy MLP for classification and rule generation , 1997, IEEE Trans. Neural Networks.

[5]  Kurt Hornik,et al.  Approximation capabilities of multilayer feedforward networks , 1991, Neural Networks.

[6]  Subhagata Chattopadhyay,et al.  Fingerprint Identification System using Tree based Matching , 2012 .

[7]  M. Cevdet Ince,et al.  An expert system for detection of breast cancer based on association rules and neural network , 2009, Expert Syst. Appl..

[8]  Pamela K. Coats,et al.  A neural network for classifying the financial health of a firm , 1995 .

[9]  Saikat Roy,et al.  A novel signature verification and authentication system using image transformations and Artificial Neural Network , 2013, 2013 World Congress on Computer and Information Technology (WCCIT).

[10]  Francisco Herrera,et al.  A Survey on the Application of Genetic Programming to Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Bhabatosh Chanda,et al.  Writer-independent off-line signature verification using surroundedness feature , 2012, Pattern Recognit. Lett..

[12]  Ju Cheng Yang,et al.  A fingerprint verification algorithm using tessellated invariant moment features , 2008, Neurocomputing.

[13]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[14]  David M. Himmelblau,et al.  Incipient fault detection and diagnosis using artificial neural networks , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[15]  Subhagata Chattopadhyay,et al.  Neurofuzzy models to automate the grading of old‐age depression , 2014, Expert Syst. J. Knowl. Eng..

[16]  Subhagata Chattopadhyay,et al.  A Fingerprint Verification Tool Using Adaptive Resonance Theory Nets , 2013 .

[17]  Muhsin Tunay Gençoglu,et al.  An expert system based on S-transform and neural network for automatic classification of power quality disturbances , 2009, Expert Syst. Appl..

[18]  Fei Yin,et al.  Online and offline handwritten Chinese character recognition: Benchmarking on new databases , 2013, Pattern Recognit..

[19]  Tong-Seng Quah,et al.  Improving returns on stock investment through neural network selection , 1999 .

[20]  Oguz Akbilgic,et al.  A novel Hybrid RBF Neural Networks model as a forecaster , 2013, Statistics and Computing.

[21]  Dominic Palmer-Brown,et al.  A modal learning adaptive function neural network applied to handwritten digit recognition , 2008, Inf. Sci..

[22]  Sen-Chi Yu,et al.  Applications of fuzzy theory on health care: an example of depression disorder classification based on FCM , 2008 .

[23]  Sheridan J. Coakes,et al.  SPSS: Analysis Without Anguish Using Spss Version 14.0 for Windows , 1999 .

[24]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[25]  Sibanda Wilbert,et al.  Novel Application of Multi-Layer Perceptrons (MLP) Neural Networks to Model HIV in South Africa using Seroprevalence Data from Antenatal Clinics , 2011 .

[26]  T. Ross.  Fuzzy Logic with Engineering Applications , 1994 .

[27]  Michael Y. Hu,et al.  Artificial neural networks in bankruptcy prediction: General framework and cross-validation analysis , 1999, Eur. J. Oper. Res..

[28]  Santanu Chaudhury,et al.  Signature verification using multiple neural classifiers , 1997, Pattern Recognit..

[29]  Moshe Leshno,et al.  Neural network prediction analysis: The bankruptcy case , 1996, Neurocomputing.

[30]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[31]  R. Lippmann.  Pattern classification using neural networks , 1989, IEEE Communications Magazine.

[32]  Robert Sabourin,et al.  A neural network approach to off-line signature verification using directional PDF , 1996, Pattern Recognit..

[33]  Ramesh Sharda,et al.  Bankruptcy prediction using neural networks , 1994, Decis. Support Syst..

[34]  A. Suhasini,et al.  Multimodel decision support system for psychiatry problem , 2011, Expert systems with applications.