Extracting rules from pruned networks for breast cancer diagnosis

A new algorithm for neural network pruning is presented. Using this algorithm, networks with small number of connections and high accuracy rates for breast cancer diagnosis are obtained. We will then describe how rules can be extracted from a pruned network by considering only a finite number of hidden unit activation values. The accuracy of the extracted rules is as high as the accuracy of the pruned network. For the breast cancer diagnosis problem, the concise rules extracted from the network achieve an accuracy rate of more than 95% on the training data set and on the test data set.

[1]  Hans Henrik Thodberg,et al.  Improving Generalization of Neural Networks Through Pruning , 1991, Int. J. Neural Syst..

[2]  Rudy Setiono,et al.  Use of a quasi-Newton method in a feedforward neural network construction algorithm , 1995, IEEE Trans. Neural Networks.

[3]  Emile Servan-Schreiber,et al.  A Connectionist Approach to the Diagnosis of Dementia , 1988 .

[4]  Rudy Setiono,et al.  A Penalty-Function Approach for Pruning Feedforward Neural Networks , 1997, Neural Computation.

[5]  G BaxtWilliam.  Use of an artificial neural network for data analysis in clinical decision-making , 1990 .

[6]  Masafumi Hagiwara,et al.  A simple and effective method for removal of hidden units and weights , 1994, Neurocomputing.

[7]  Panos M. Pardalos,et al.  Advances in Optimization and Parallel Computing , 1992 .

[8]  O. Mangasarian,et al.  Multisurface method of pattern separation for medical diagnosis applied to breast cytology. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Raymond L. Watrous.  Learning Algorithms for Connectionist Networks: Applied Gradient Methods of Nonlinear Optimization , 1988 .

[10]  Thomas F. Coleman,et al.  Large-Scale Numerical Optimization , 1990 .

[11]  Michael C. Mozer,et al.  Skeletonization: A Technique for Trimming the Fat from a Network via Relevance Assessment , 1988, NIPS.

[12]  William G. Baxt,et al.  Use of an Artificial Neural Network for Data Analysis in Clinical Decision-Making: The Diagnosis of Acute Coronary Occlusion , 1990, Neural Computation.

[13]  Ehud D. Karnin,et al.  A simple procedure for pruning back-propagation trained neural networks , 1990, IEEE Trans. Neural Networks.

[14]  Arjen van Ooyen,et al.  Improving the convergence of the back-propagation algorithm , 1992, Neural Networks.

[15]  W H Wolberg,et al.  Diagnostic schemes for fine needle aspirates of breast masses. , 1988, Analytical and quantitative cytology and histology.

[16]  O. Mangasarian,et al.  Pattern Recognition Via Linear Programming: Theory and Application to Medical Diagnosis , 1989 .

[17]  Korris Fu-Lai Chung,et al.  A Node Pruning Algorithm for Backpropagation Networks , 1992, Int. J. Neural Syst..

[18]  Sungzoon Cho,et al.  Multiple disorder diagnosis with adaptive competitive neural networks , 1993, Artif. Intell. Medicine.