Extracting classification rules from modified fuzzy min-max neural network for data with mixed attributes

Graphical abstractDisplay Omitted HighlightsProposed method modifies the fuzzy min-max neural network to handle both continuous and discrete attributes effectively.It prunes the trained network to reduce the number of hyperboxes created.Rules are extracted from the pruned network which justifies its classification results. This paper proposes the modified fuzzy min-max neural network (MFMMN) classification model to perform the supervised classification of data. The basic fuzzy min-max neural network (FMMN) can only be applied to the continuous attribute values and cannot handle the discrete values. Also justification of the classification results given by FMMN required to be obtained to make it more applicable to real world applications. These both issues are solved in the proposed MFMMN. In the MFMMN, each hyperbox have min-max values defined in terms of continuous attributes and a set of binary strings defined for discrete attributes. Bitwise 'and' and 'or' operators are used to update the discrete values associated with each hyperbox. The trained network is pruned to remove the less useful hyperboxes based on their confidence factor. The proposed model is applied to nine different datasets taken from the University of California, Irvine (UCI) machine learning repository. Finally the case study of a real time weather data is evaluated using MFMMN. The experimental results show that the proposed model has given very good accuracy. In addition to accuracy, the number of hyperboxes obtained after pruning are very less which lead to less number of concise rules and reduced computational complexity.

[1]  Pilar Rey-del-Castillo,et al.  Fuzzy min–max neural networks for categorical data: application to missing data imputation , 2012 .

[2]  Russell Reed,et al.  Pruning algorithms-a survey , 1993, IEEE Trans. Neural Networks.

[3]  Uday V. Kulkarni,et al.  Fuzzy hypersphere neural network classifier , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[4]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[5]  Joachim Diederich,et al.  The truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks , 1998, IEEE Trans. Neural Networks.

[6]  Snehasis Mukhopadhyay,et al.  A comparative study of genetic sequence classification algorithms , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[7]  Chee Peng Lim,et al.  A Modified Fuzzy Min-Max Neural Network and Its Application to Fault Classification , 2007 .

[8]  Chee Peng Lim,et al.  A modified fuzzy min-max neural network with rule extraction and its application to fault detection and classification , 2008, Appl. Soft Comput..

[9]  Antonello Rizzi,et al.  Adaptive resolution min-max classifiers , 2002, IEEE Trans. Neural Networks.

[10]  Mir Hossein Dezfoulian,et al.  M-FMCN: modified fuzzy min-max classifier using compensatory neurons , 2012 .

[11]  Bogdan Gabrys,et al.  Agglomerative Learning Algorithms for General Fuzzy Min-Max Neural Network , 2002, J. VLSI Signal Process..

[12]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[13]  Shigeo Abe,et al.  Pattern Classification: Neuro-fuzzy Methods and Their Comparison , 2012 .

[14]  Andrzej Bargiela,et al.  Exclusion/Inclusion Fuzzy Classification Network , 2003, KES.

[15]  Muharram Mansoorizadeh,et al.  Multi-Level Fuzzy Min-Max Neural Network Classifier , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[16]  Dazhong Ma,et al.  Data-Core-Based Fuzzy Min–Max Neural Network for Pattern Classification , 2011, IEEE Transactions on Neural Networks.

[17]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[18]  T. R. Sontakke,et al.  Fuzzy hyperline segment neural network for rotation invariant handwritten character recognition , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[19]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[20]  B. E. Segee,et al.  Fault tolerance of pruned multilayer networks , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[21]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[22]  R.J.F. Dow,et al.  Neural net pruning-why and how , 1988, IEEE 1988 International Conference on Neural Networks.

[23]  Bart Baesens,et al.  Recursive Neural Network Rule Extraction for Data With Mixed Attributes , 2008, IEEE Transactions on Neural Networks.

[24]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[25]  Richard D. Braatz,et al.  Universal approximation with error bounds for dynamic artificial neural network models: A tutorial and some new results , 2011, 2011 IEEE International Symposium on Computer-Aided Control System Design (CACSD).

[26]  Chia-Chong Chen,et al.  DESIGN OF A FUZZY MIN-MAX HYPERBOX CLASSIFIER USING A SUPERVISED LEARNING METHOD , 2006, Cybern. Syst..

[27]  Antonello Rizzi,et al.  A recursive algorithm for fuzzy min-max networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[28]  Jocelyn Sietsma,et al.  Creating artificial neural networks that generalize , 1991, Neural Networks.

[29]  P. K. Simpson,et al.  Fuzzy min-max neural networks , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[30]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[31]  Dazhong Ma,et al.  An Adaptive Fuzzy Min-Max Neural Network Classifier Based on Principle Component Analysis and Adaptive Genetic Algorithm , 2012 .

[32]  Prabir Kumar Biswas,et al.  A Fuzzy Min-Max Neural Network Classifier With Compensatory Neuron Architecture , 2007, IEEE Transactions on Neural Networks.

[33]  Chee Peng Lim,et al.  A Modified Fuzzy Min–Max Neural Network With a Genetic-Algorithm-Based Rule Extractor for Pattern Classification , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[34]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[35]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.