A comparison between two neural network rule extraction techniques for the diagnosis of hepatobiliary disorders

Neural networks have been widely used as tools for prediction in medicine. We expect to see even more applications of neural networks for medical diagnosis as recently developed neural network rule extraction algorithms make it possible for the decision process of a trained network to be expressed as classification rules. These rules are more comprehensible to a human user than the classification process of the networks which involves complex nonlinear mapping of the input data. This paper reports the results from two neural network rule extraction techniques, NeuroLinear and NeuroRule applied to the diagnosis of hepatobiliary disorders. The dataset consists of nine measurements collected from patients in a Japanese hospital and these measurements have continuous values. NeuroLinear generates piece-wise linear discriminant functions for this dataset. The continuous measurements have previously been discretized by domain experts. NeuroRule is applied to the discretized dataset to generate symbolic classification rules. We compare the rules generated by the two techniques and find that the rules generated by NeuroLinear from the original continuously valued dataset to be slightly more accurate and more concise than the rules generated by NeuroRule from the discretized dataset.

[1]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[2]  R. Setiono.  Extracting Rules from Pruned Neural Networks for Breast Cancer Diagnosis , 1996 .

[3]  George D. Magoulas,et al.  Improving the Convergence of the Backpropagation Algorithm Using Learning Rate Adaptation Methods , 1999, Neural Computation.

[4]  Georg Dorffner,et al.  Neural networks for recognizing patterns in cardiotocograms , 1998, Artif. Intell. Medicine.

[5]  Joydeep Ghosh,et al.  Symbolic Interpretation of Artificial Neural Networks , 1999, IEEE Trans. Knowl. Data Eng..

[6]  Ah-Hwee Tan,et al.  Rule Extraction: From Neural Architecture to Symbolic Representation , 1995 .

[7]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[8]  Murray Smith,et al.  Neural Networks for Statistical Modeling , 1993 .

[9]  Sushmita Mitra,et al.  Fuzzy MLP based expert system for medical diagnosis , 1994, CVPR 1994.

[10]  Franklin A. Graybill,et al.  Introduction to The theory , 1974 .

[11]  Rudy Setiono.  A Neural Network Construction Algorithm which Maximizes the Likelihood Function , 1995, Connect. Sci..

[12]  Huan Liu,et al.  Symbolic Representation of Neural Networks , 1996, Computer.

[13]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[14]  David B. Fogel,et al.  Evolving artificial neural networks for screening features from mammograms , 1998, Artif. Intell. Medicine.

[15]  Chris D. Nugent,et al.  Computerised electrocardiology employing bi-group neural networks , 1998, Artif. Intell. Medicine.

[16]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[17]  Arjen van Ooyen,et al.  Improving the convergence of the back-propagation algorithm , 1992, Neural Networks.

[18]  Yoichi Hayashi,et al.  Neural expert system using fuzzy teaching input and its application to medical diagnosis , 1994 .

[19]  Michael C. Mozer,et al.  Using Relevance to Reduce Network Size Automatically , 1989 .

[20]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[21]  Huan Liu,et al.  NeuroLinear: From neural networks to oblique decision rules , 1997, Neurocomputing.

[22]  Rudy Setiono,et al.  Extracting Rules from Neural Networks by Pruning and Hidden-Unit Splitting , 1997, Neural Computation.

[23]  Rudy Setiono,et al.  A Penalty-Function Approach for Pruning Feedforward Neural Networks , 1997, Neural Computation.

[24]  Shirley Dex,et al.  JR 旅客販売総合システム（マルス）における運用及び管理について , 1991 .

[25]  Martti Juhola,et al.  Treatment of missing data values in a neural network based decision support system for acute abdominal pain , 1998, Artif. Intell. Medicine.

[26]  Sungzoon Cho,et al.  Multiple disorder diagnosis with adaptive competitive neural networks , 1993, Artif. Intell. Medicine.

[27]  LiMin Fu,et al.  Neural networks in computer intelligence , 1994 .

[28]  Raymond L. Watrous.  Learning Algorithms for Connectionist Networks: Applied Gradient Methods of Nonlinear Optimization , 1988 .