Rule Extraction from DEWNN to Solve Classification and Regression Problems

This paper proposes a method to extract rules from differential evolution trained wavelet neural network (DEWNN) [1]. for solving classification and regression problems. The rule generation methods viz., Decision Tree (DT), Ripper and Classification and Regression Tree (CART) and Dynamic Evolving Neuro Fuzzy Inference System (DENFIS) are employed to extract rules from DEWNN for classification and regression problems respectively. The feature selection algorithm adapted by Chauhan et al., [1] is used in the present study. The effectiveness of the proposed hybrid is evaluated on Iris, Wine and four bankruptcy prediction datasets namely Spanish banks, Turkish banks, US banks, UK banks and Auto MPG dataset, Body fat dataset, Boston Housing dataset, Forest Fires dataset, Pollution dataset, by using 10-fold cross validation. From the results, it is concluded that the proposed hybrid method performed well in terms of sensitivity in classification problems.

[1]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[2]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[3]  Ignacio Olmeda,et al.  Hybrid Classifiers for Financial Multicriteria Decision Making: The Case of Bankruptcy Prediction , 1997 .

[4]  Serpil Canbas,et al.  Prediction of commercial bank failure via multivariate statistical analysis of financial structures: The Turkish case , 2005, Eur. J. Oper. Res..

[5]  Vadlamani Ravi,et al.  Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks , 2009, Expert Syst. Appl..

[6]  Vadlamani Ravi,et al.  Software development cost estimation using wavelet neural networks , 2008, J. Syst. Softw..

[7]  A. Asuncion,et al.  UCI Machine Learning Repository, University of California, Irvine, School of Information and Computer Sciences , 2007 .

[8]  Jude Shavlik,et al.  THE EXTRACTION OF REFINED RULES FROM KNOWLEDGE BASED NEURAL NETWORKS , 1993 .

[9]  George Kalliris,et al.  Bowel-sound pattern analysis using wavelets and neural networks with application to long-term, unsupervised, gastrointestinal motility monitoring , 2008, Expert Syst. Appl..

[10]  Nikola K. Kasabov,et al.  DENFIS: dynamic evolving neural-fuzzy inference system and its application for time-series prediction , 2002, IEEE Trans. Fuzzy Syst..

[11]  LiMin Fu,et al.  Rule Generation from Neural Networks , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[12]  H. Levent Akin,et al.  Rule extraction from trained neural networks using genetic algorithms , 1997 .

[13]  V. Ravi,et al.  Software Reliability Prediction Using Wavelet Neural Networks , 2007, International Conference on Computational Intelligence and Multimedia Applications (ICCIMA 2007).

[14]  R. Krishnan,et al.  A search technique for rule extraction from trained neural networks , 1999, Pattern Recognit. Lett..

[15]  S. Srinivas Kumar,et al.  Automatic Watershed Segmentation and Comparison between Pixel Scan Method and Order-Invariant Algorithm for Image Segmentation , 2007 .

[16]  Weigen Chen,et al.  Fault diagnostic method of power transformers based on hybrid genetic algorithm evolving wavelet neural network , 2008 .

[17]  Shung-Yung Lung Efficient text independent speaker recognition with wavelet feature selection based multilayered neural network using supervised learning algorithm , 2007, Pattern Recognit..

[18]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[19]  Stephen I. Gallant,et al.  Connectionist expert systems , 1988, CACM.

[20]  M. Beynon,et al.  Variable precision rough set theory and data discretisation: an application to corporate failure prediction , 2001 .

[21]  C. Raghavendra Rao,et al.  Differential evolution trained radial basis function network: application to bankruptcy prediction in banks , 2010, Int. J. Bio Inspired Comput..

[22]  Engin Avci,et al.  An expert system based on Wavelet Neural Network-Adaptive Norm Entropy for scale invariant texture classification , 2007, Expert Syst. Appl..

[23]  Jude W. Shavlik,et al.  Extracting Refined Rules from Knowledge-Based Neural Networks , 1993, Machine Learning.

[24]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[25]  Sung-Nien Yu,et al.  Electrocardiogram beat classification based on wavelet transformation and probabilistic neural network , 2007, Pattern Recognit. Lett..

[26]  Yilu Liu,et al.  Rough set and fuzzy wavelet neural network integrated with least square weighted fusion algorithm based fault diagnosis research for power transformers , 2008 .

[27]  Ruisheng Zhang,et al.  Prediction of Programmed-temperature Retention Values of Naphthas by Wavelet Neural Networks , 2001, Comput. Chem..

[28]  C. James Li,et al.  DIAGNOSTIC RULE EXTRACTION FROM TRAINED FEEDFORWARD NEURAL NETWORKS , 2002 .