Pruning and rule extraction using class entropy

The described methodology addresses domain-characterization and knowledge-explicitation in difficult decision-making problems. In the framework of best exploiting class information, several pruning methods lead to effective tools for analyzing the complexity of a representation problem. A divide-and-conquer strategy results in a hierarchical procedure for extracting rules to synthesize the observed domain. Application to a real, complex clinical problem provides a valuable and satisfactory testbed for all aspects of the described methodology.<<ETX>>

[1]  Norio Baba,et al.  A new approach for finding the global minimum of error function of neural networks , 1989, Neural Networks.

[2]  David E. Rumelhart,et al.  Generalization by Weight-Elimination with Application to Forecasting , 1990, NIPS.

[3]  H J Moens,et al.  Computer-assisted diagnosis of rheumatic disorders. , 1991, Seminars in arthritis and rheumatism.

[4]  Jude W. Shavlik,et al.  Interpretation of Artificial Neural Networks: Mapping Knowledge-Based Neural Networks into Rules , 1991, NIPS.

[5]  Sandro Ridella,et al.  Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithmCorrigenda for this article is available here , 1987, TOMS.

[6]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[7]  Rodolfo Zunino,et al.  Automated diagnosis and disease characterization using neural network analysis , 1992, [Proceedings] 1992 IEEE International Conference on Systems, Man, and Cybernetics.

[8]  Ralph Linsker,et al.  Self-organization in a perceptual network , 1988, Computer.

[9]  R. Nakano,et al.  Medical diagnostic expert system based on PDP model , 1988, IEEE 1988 International Conference on Neural Networks.

[10]  Geoffrey E. Hinton,et al.  Simplifying Neural Networks by Soft Weight-Sharing , 1992, Neural Computation.

[11]  Peter Seitz,et al.  Minimum class entropy: A maximum information approach to layered networks , 1989, Neural Networks.

[12]  Yann LeCun,et al.  Optimal Brain Damage , 1989, NIPS.