Black-Box Classifier Interpretation Using Decision Tree and Fuzzy Logic-Based Classifier Implementation

Black-box classifiers, such as artificial neural network and support vector machine, are a popular classifier because of its remarkable performance. They are applied in various fields such as inductive inferences, classifications, or regressions. However, by its characteristics, they cannot provide appropriate explanations how the classification results are derived. Therefore, there are plenty of actively discussed researches about interpreting trained black-box classifiers. In this paper, we propose a method to make a fuzzy logic-based classifier using extracted rules from the artificial neural network and support vector machine in order to interpret internal structures. As an object of classification, an anomalous propagation echo is selected which occurs frequently in radar data and becomes the problem in a precipitation estimation process. After applying a clustering method, learning dataset is generated from clusters. Using the learning dataset, artificial neural network and support vector machine are implemented. After that, decision trees for each classifier are generated. And they are used to implement simplified fuzzy logic-based classifiers by rule extraction and input selection. Finally, we can verify and compare performances. With actual occurrence cased of the anomalous propagation echo, we can determine the inner structures of the black-box classifiers.

[1]  Rudy Setiono,et al.  Extracting Rules from Neural Networks by Pruning and Hidden-Unit Splitting , 1997, Neural Computation.

[2]  B. J. Taylor,et al.  Rule extraction as a formal method for the verification and validation of neural networks , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[3]  Robert Fullér,et al.  Neural Fuzzy Systems , 1995 .

[4]  Andrew P. Bradley,et al.  Rule extraction from support vector machines: A review , 2010, Neurocomputing.

[5]  Yi Pan,et al.  Rule generation for protein secondary structure prediction with support vector machines and decision tree , 2006, IEEE Transactions on NanoBioscience.

[6]  Ian D. Cluckie,et al.  Classification of Ground Clutter and Anomalous Propagation Using Dual-Polarization Weather Radar , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Marcus O'Connor,et al.  Artificial neural network models for forecasting and decision making , 1994 .

[8]  Andrew P. Bradley,et al.  Rule Extraction from Support Vector Machines: A Sequential Covering Approach , 2007, IEEE Transactions on Knowledge and Data Engineering.

[9]  Huan Liu,et al.  Symbolic Representation of Neural Networks , 1996, Computer.

[10]  Sheng-De Wang,et al.  Fuzzy support vector machines , 2002, IEEE Trans. Neural Networks.

[11]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[12]  Sungshin Kim,et al.  Real-Time Detection and Filtering of Chaff Clutter from Single-Polarization Doppler Radar Data , 2013 .

[13]  Matthias Steiner,et al.  Use of Three-Dimensional Reflectivity Structure for Automated Detection and Removal of Nonprecipitating Echoes in Radar Data , 2002 .

[14]  Xiuju Fu,et al.  Extracting the knowledge embedded in support vector machines , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[15]  Amit Gupta,et al.  Generalized Analytic Rule Extraction for Feedforward Neural Networks , 1999, IEEE Trans. Knowl. Data Eng..

[16]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[17]  Paulo J. G. Lisboa,et al.  Orthogonal search-based rule extraction (OSRE) for trained neural networks: a practical and efficient approach , 2006, IEEE Transactions on Neural Networks.