Fuzzy DIFACONN-miner: A novel approach for fuzzy rule extraction from neural networks

Artificial neural networks (ANNs) are mathematical models inspired from the biological nervous system. They have the ability of predicting, learning from experiences and generalizing from previous examples. An important drawback of ANNs is their very limited explanation capability, mainly due to the fact that knowledge embedded within ANNs is distributed over the activations and the connection weights. Therefore, one of the main challenges in the recent decades is to extract classification rules from ANNs. This paper presents a novel approach to extract fuzzy classification rules (FCR) from ANNs because of the fact that fuzzy rules are more interpretable and cope better with pervasive uncertainty and vagueness with respect to crisp rules. A soft computing based algorithm is developed to generate fuzzy rules based on a data mining tool (DIFACONN-miner), which was recently developed by the authors. Fuzzy DIFACONN-miner algorithm can extract fuzzy classification rules from datasets containing both categorical and continuous attributes. Experimental research on the benchmark datasets and comparisons with other fuzzy rule based classification (FRBC) algorithms has shown that the proposed algorithm yields high classification accuracies and comprehensible rule sets.

[1]  Mark Craven,et al.  Extracting comprehensible models from trained neural networks , 1996 .

[2]  Hao Xing,et al.  Extract intelligible and concise fuzzy rules from neural networks , 2002, Fuzzy Sets Syst..

[3]  T. Martin McGinnity,et al.  An approach for on-line extraction of fuzzy rules using a self-organising fuzzy neural network , 2005, Fuzzy Sets Syst..

[4]  Nikola K. Kasabov,et al.  Learning fuzzy rules and approximate reasoning in fuzzy neural networks and hybrid systems , 1996, Fuzzy Sets Syst..

[5]  Jude W. Shavlik,et al.  Using Sampling and Queries to Extract Rules from Trained Neural Networks , 1994, ICML.

[6]  Saroj,et al.  A Genetic-Fuzzy Algorithm to Discover Fuzzy Classification Rules for Mixed Attributes Datasets , 2011 .

[7]  Lale Özbakir,et al.  TACO-miner: An ant colony based algorithm for rule extraction from trained neural networks , 2009, Expert Syst. Appl..

[8]  Nikola K. Kasabov,et al.  On-line learning, reasoning, rule extraction and aggregation in locally optimized evolving fuzzy neural networks , 2001, Neurocomputing.

[9]  Sebastian Thrun,et al.  Extracting Provably Correct Rules from Artificial Neural Networks , 1993 .

[10]  Sushmita Mitra,et al.  Fuzzy MLP based expert system for medical diagnosis , 1994, CVPR 1994.

[11]  Alex A. Freitas,et al.  An Ant Colony Algorithm for Classification Rule Discovery , 2002 .

[12]  Jude W. Shavlik,et al.  Extracting Refined Rules from Knowledge-Based Neural Networks , 1993, Machine Learning.

[13]  Rudolf Kruse,et al.  A neuro-fuzzy method to learn fuzzy classification rules from data , 1997, Fuzzy Sets Syst..

[14]  Chee Peng Lim,et al.  A modified fuzzy min-max neural network with rule extraction and its application to fault detection and classification , 2008, Appl. Soft Comput..

[15]  Jude Shavlik,et al.  THE EXTRACTION OF REFINED RULES FROM KNOWLEDGE BASED NEURAL NETWORKS , 1993 .

[16]  Antonio J. Rivera,et al.  GP-COACH: Genetic Programming-based learning of COmpact and ACcurate fuzzy rule-based classification systems for High-dimensional problems , 2010, Inf. Sci..

[17]  Duc Truong Pham,et al.  Computational Intelligence: for Engineering and Manufacturing , 2007 .

[18]  Nelson F. F. Ebecken,et al.  Extracting rules from multilayer perceptrons in classification problems: A clustering-based approach , 2006, Neurocomputing.

[19]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[20]  Hans-Jürgen Zimmermann,et al.  Pattern classification with principal component analysis and fuzzy rule bases , 2000, Eur. J. Oper. Res..

[21]  R. Krishnan,et al.  A search technique for rule extraction from trained neural networks , 1999, Pattern Recognit. Lett..

[22]  Lale Özbakir,et al.  MEPAR-miner: Multi-expression programming for classification rule mining , 2007, Eur. J. Oper. Res..

[23]  Lale Özbakir,et al.  A soft computing-based approach for integrated training and rule extraction from artificial neural networks: DIFACONN-miner , 2010, Appl. Soft Comput..

[24]  Tharam S. Dillon,et al.  Automated knowledge acquisition , 1994, Prentice Hall International series in computer science and engineering.