Mining classification rules from fuzzy min-max neural network

The basic fuzzy min-max neural network (FMMN) is capable to perform the supervised classification of data. As like other artificial neural networks, FMMN is also like a black box and expressed in terms of min-max values and associated class label. So the justification of classification results given by FMMN is required to be obtained to make it more adaptive to the real world applications. This paper proposes the model to extract classification rules from trained FMMN. These rules justify the classification decision given by FMMN. For this FMMN is trained for the input data and resulting min-max values in the quantized form and class labels of created hyperboxes are passed as a input to the partial rule extraction (PART) algorithm of Waikato Environment for Knowledge Analysis (WEKA). As a result, more comprehensible rules expressed in terms human readable linguistic terms are extracted. The proposed model is applied to iris and wine dataset taken from the UCI machine learning repository. Thus the extracted rules represent the trained FMMN in the more understandable form and can easily be applied to real world applications.

[1]  Andrzej Bargiela,et al.  General fuzzy min-max neural network for clustering and classification , 2000, IEEE Trans. Neural Networks Learn. Syst..

[2]  Andrzej Bargiela,et al.  Exclusion/Inclusion Fuzzy Classification Network , 2003, KES.

[3]  Chee Peng Lim,et al.  A modified fuzzy min-max neural network with rule extraction and its application to fault detection and classification , 2008, Appl. Soft Comput..

[4]  Antonello Rizzi,et al.  Adaptive resolution min-max classifiers , 2002, IEEE Trans. Neural Networks.

[5]  Mir Hossein Dezfoulian,et al.  M-FMCN: modified fuzzy min-max classifier using compensatory neurons , 2012 .

[6]  Antonello Rizzi,et al.  A recursive algorithm for fuzzy min-max networks , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[7]  Bogdan Gabrys,et al.  Agglomerative Learning Algorithms for General Fuzzy Min-Max Neural Network , 2002, J. VLSI Signal Process..

[8]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.

[9]  Shigeo Abe,et al.  Pattern Classification: Neuro-fuzzy Methods and Their Comparison , 2012 .

[10]  Prabir Kumar Biswas,et al.  A fuzzy min-max neural network classifier with compensatory neuron architecture , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[11]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks - Part 2: Clustering , 1993, IEEE Trans. Fuzzy Syst..

[12]  Ignacio Requena,et al.  Are artificial neural networks black boxes? , 1997, IEEE Trans. Neural Networks.

[13]  T. R. Sontakke,et al.  General fuzzy hyperline segment neural network , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[14]  E. E. Eldukhri,et al.  Image segmentation using fuzzy min-max neural networks for wood defect detection , 2005 .

[15]  Joachim Diederich,et al.  The truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks , 1998, IEEE Trans. Neural Networks.

[16]  Christopher J. C. Burges,et al.  Simplified Support Vector Decision Rules , 1996, ICML.

[17]  P. K. Simpson Fuzzy Min-Max Neural Networks-Part 1 : Classification , 1992 .

[18]  Dazhong Ma,et al.  An Adaptive Fuzzy Min-Max Neural Network Classifier Based on Principle Component Analysis and Adaptive Genetic Algorithm , 2012 .

[19]  Muharram Mansoorizadeh,et al.  Multi-Level Fuzzy Min-Max Neural Network Classifier , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Cheng-Jian Lin,et al.  An entropy-based quantum neuro-fuzzy inference system for classification applications , 2007, Neurocomputing.

[21]  Chia-Chong Chen,et al.  DESIGN OF A FUZZY MIN-MAX HYPERBOX CLASSIFIER USING A SUPERVISED LEARNING METHOD , 2006, Cybern. Syst..

[22]  Dazhong Ma,et al.  Data-Core-Based Fuzzy Min–Max Neural Network for Pattern Classification , 2011, IEEE Transactions on Neural Networks.

[23]  G. N. Shinde,et al.  Iris Recognition Using Fuzzy Min-Max Neural Network , 2011 .

[24]  Uday V. Kulkarni,et al.  Fuzzy hypersphere neural network classifier , 2001, 10th IEEE International Conference on Fuzzy Systems. (Cat. No.01CH37297).

[25]  Snehasis Mukhopadhyay,et al.  A comparative study of genetic sequence classification algorithms , 2002, Proceedings of the 12th IEEE Workshop on Neural Networks for Signal Processing.

[26]  Geoff Holmes,et al.  Generating Rule Sets from Model Trees , 1999, Australian Joint Conference on Artificial Intelligence.

[27]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[28]  Patrick K. Simpson,et al.  Fuzzy min-max neural networks. I. Classification , 1992, IEEE Trans. Neural Networks.

[29]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[30]  T. R. Sontakke,et al.  Fuzzy hyperline segment neural network for rotation invariant handwritten character recognition , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).