Linguistic Knowledge Extraction from Neural Networks Using Maximum Weight and Frequency Data Representation

This paper presents a method of linguistic rule extraction from neural networks nodes pruning using frequency interval data representation. The method composes of two steps which are 1) neural networks nodes pruning by analysis on the maximum weight and 2) linguistic rule extraction using frequency interval data representation. The study has tested with the benchmark data sets such as heart disease, Wisconsin breast cancer, Pima Indians diabetes, and electrocardiography data set of heart disease patients from hospitals in Thailand. The study found that the linguistic rules received had high accuracy and easy to understand. The number of rules and the number of conjunction of conditions were small and the training time was also decreased

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Chidchanok Lursinsap,et al.  Rule extraction from neural networks using fuzzy sets , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[3]  Rudy Setiono,et al.  Generating concise and accurate classification rules for breast cancer diagnosis , 2000, Artif. Intell. Medicine.

[4]  Amit Gupta,et al.  Generalized Analytic Rule Extraction for Feedforward Neural Networks , 1999, IEEE Trans. Knowl. Data Eng..

[5]  Hao Xing,et al.  Extract intelligible and concise fuzzy rules from neural networks , 2002, Fuzzy Sets Syst..

[6]  Xinchuan Zeng,et al.  Feature weighting using neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[7]  Xi-Zhao Wang,et al.  A new approach to weighted fuzzy production rule extraction from neural networks , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[8]  M. Nii,et al.  Reduction of input vectors by using of attribute selection in rule extraction method from trained neural networks , 2003, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[9]  Guido Bologna,et al.  A model for single and multiple knowledge based networks , 2003, Artif. Intell. Medicine.

[10]  Guido Bologna,et al.  Is it worth generating rules from neural network ensembles? , 2004, J. Appl. Log..

[11]  Wlodzislaw Duch,et al.  A new methodology of extraction, optimization and application of crisp and fuzzy logical rules , 2001, IEEE Trans. Neural Networks.