Genetic Algorithm based Rule Extraction from Pruned Modified Fuzzy Hyperline Segment Neural Network for Pattern Classification

The Pruned modified fuzzy hyperline segment neural network (PMFHLSNN) is pruned extension of Fuzzy hyperline segment neural network (FHLSNN) with modification in the testing phase. In this paper, a genetic algorithm based rule extractor (GA-PMFHLSNN) is proposed to extract a small set of compact and comprehensible fuzzy if-then rules with high classification accuracy from the PMFHLSNN. After pruning, open hyperline segments are generated from the remaining hyperline segments and a ―don‘t care‖ approach is adopted by GA rule extractor to minimize the number of features in the extracted rules with higher classification accuracy. The performance of FHLSNN, PMFHLSNN and GAPMFHLSNN are evaluated using tenfold cross-validation for five benchmark problems and handwritten character database. All the results show that the proposed approach can extract a set of compact and comprehensible rules with high classification accuracy for all the selected datasets. General Terms Pruned modified fuzzy hyperline segment neural network, Rule extraction, Pattern Classification.

[1]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Chee Peng Lim,et al.  Improved GART Neural Network Model for Pattern Classification and Rule Extraction With Application to Power Systems , 2011, IEEE Transactions on Neural Networks.

[4]  Anh Hoang,et al.  Supervised Classifier Performance on the Uci Database , 2007 .

[5]  T. R. Sontakke,et al.  Rotation, scale and translation invariant handwritten Devanagari numeral character recognition using general fuzzy neural network , 2007, Pattern Recognit..

[6]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[7]  Kuo-Chin Fan,et al.  Applying genetic algorithms on pattern recognition: an analysis and survey , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[9]  U. V. Kulkarni,et al.  Pruned Modified Fuzzy Hyperline Segment Neural Network and Its Application to Pattern Classification , 2014 .

[10]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[11]  Yang Xu,et al.  A Genetic Algorithm Based Multilevel Association Rules Mining for Big Datasets , 2014 .

[12]  Sung-Kwun Oh,et al.  Multilayer hybrid fuzzy neural networks: synthesis via technologies of advanced computational intelligence , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Chee Peng Lim,et al.  A Modified Fuzzy Min–Max Neural Network With a Genetic-Algorithm-Based Rule Extractor for Pattern Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Michael Margaliot,et al.  Are artificial neural networks white boxes? , 2005, IEEE Transactions on Neural Networks.

[15]  Nikhil R. Pal,et al.  An Integrated Mechanism for Feature Selection and Fuzzy Rule Extraction for Classification , 2012, IEEE Transactions on Fuzzy Systems.

[16]  Sung-Bae Cho,et al.  Pattern recognition with neural networks combined by genetic algorithm , 1999, Fuzzy Sets Syst..

[17]  Paulo J. G. Lisboa,et al.  Translation, rotation, and scale invariant pattern recognition by high-order neural networks and moment classifiers , 1992, IEEE Trans. Neural Networks.

[18]  T. R. Sontakke,et al.  Fuzzy hyperline segment neural network for rotation invariant handwritten character recognition , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[19]  Xiao-Hua Yu,et al.  A new pruning algorithm for neural network dimension analysis , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[20]  E. Mizutani,et al.  Neuro-Fuzzy and Soft Computing-A Computational Approach to Learning and Machine Intelligence [Book Review] , 1997, IEEE Transactions on Automatic Control.

[21]  Hisao Ishibuchi,et al.  Single-objective and two-objective genetic algorithms for selecting linguistic rules for pattern classification problems , 1997, Fuzzy Sets Syst..

[22]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[23]  T. R. Sontakke,et al.  Fuzzy hyperline segment clustering neural network , 2001 .

[24]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[25]  P. K. Simpson.  Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[26]  Din-Chang Tseng,et al.  Invariant handwritten Chinese character recognition using fuzzy min-max neural networks , 1997, Pattern Recognit. Lett..

[27]  S. B. Bagal,et al.  Modified Fuzzy Hyperline Segment Neural Network for Pattern Classification and Recognition , 2014 .