Direct Explanations and Knowledge Extraction from a Multilayer Perceptron Network that Performs Low Back Pain Classification

Using a new method published by the first author, this chapter shows how knowledge in the form of a ranked data relationship and an induced rule can be directly extracted from each training case for a Multi-layer Perceptron (MLP) network with binary inputs. The knowledge extracted from all training cases can be used to validate the MLP network and the ranked data relationship for any input case provides direct user explanations. The method is demonstrated for example training cases from a real-world MLP that classifies low back pain patients into three diagnostic classes. In using the method to validate the network a number of test cases apparently mis-classified by the network were found to have most likely been incorrectly classified by the clinicians. The method uses a direct approach which does not depend on combinatorial search and is thus applicable to real-world networks with large numbers of input features, as demonstrated in this current study.

[1]  Stephen I. Gallant,et al.  Neural network learning and expert systems , 1993 .

[2]  Kazumi Saito,et al.  Law Discovery using Neural Networks , 1997, IJCAI.

[3]  Raymond J. Mooney,et al.  Changing the Rules: A Comprehensive Approach to Theory Refinement , 1990, AAAI.

[4]  S. Bigos,et al.  Acute Low Back Problems in Adults, AHCPR Guideline No. 14 , 1996 .

[5]  Carl G. Looney,et al.  Pattern recognition using neural networks , 1997 .

[6]  D. G. Bounds,et al.  A multilayer perceptron network for the diagnosis of low back pain , 1988, IEEE 1988 International Conference on Neural Networks.

[7]  Rudy Setiono,et al.  Extracting Rules from Neural Networks by Pruning and Hidden-Unit Splitting , 1997, Neural Computation.

[8]  Dan W. Patterson,et al.  Artificial Neural Networks: Theory and Applications , 1998 .

[9]  F. Maire,et al.  A partial order for the M-of-N rule-extraction algorithm , 1997, IEEE Trans. Neural Networks.

[10]  Marylin L. Vaughn,et al.  Direct knowledge discovery and interpretation from a multilayer perception network which performs low-back-pain classification , 1999, KDD 1999.

[11]  Joydeep Ghosh,et al.  Symbolic Interpretation of Artificial Neural Networks , 1999, IEEE Trans. Knowl. Data Eng..

[12]  Jude W. Shavlik,et al.  Using Sampling and Queries to Extract Rules from Trained Neural Networks , 1994, ICML.

[13]  Jude W. Shavlik,et al.  Learning Symbolic Rules Using Artificial Neural Networks , 1993, ICML.

[14]  LiMin Fu,et al.  Neural networks in computer intelligence , 1994 .

[15]  Joachim Diederich,et al.  Survey and critique of techniques for extracting rules from trained artificial neural networks , 1995, Knowl. Based Syst..

[16]  Herna L. Viktor,et al.  Reduction of symbolic rules from artificial neural networks using sensitivity analysis , 1995, Proceedings of ICNN'95 - International Conference on Neural Networks.

[17]  C M de Villiers,et al.  A New Clinical Model For The Treatment Of Acute Low Back Pain , 1997 .

[18]  P. Arabshahi,et al.  Guest Editorial Everyday Applications Of Neural Networks , 1997, IEEE Trans. Neural Networks.

[19]  Joachim Diederich,et al.  The truth will come to light: directions and challenges in extracting the knowledge embedded within trained artificial neural networks , 1998, IEEE Trans. Neural Networks.

[20]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[21]  Sebastian Thrun,et al.  Extracting Rules from Artifical Neural Networks with Distributed Representations , 1994, NIPS.

[22]  David G. Bounds,et al.  A comparison of neural network and other pattern recognition approaches to the diagnosis of low back disorders , 1990, Neural Networks.

[23]  Marilyn Lougher Vaughn Derivation of the multilayer perceptron weight constraints for direct network interpretation and knowledge discovery , 1999, Neural Networks.

[24]  G. Waddell,et al.  Symptoms and signs: physical disease or illness behaviour? , 1984, British medical journal.

[25]  G. Waddell,et al.  1987 Volvo Award in Clinical Sciences: A New Clinical Model for the Treatment of Low-Back Pain , 1987, Spine.