Inductive and Bayesian learning in medical diagnosis

Abstract Although successful in medical diagnostic problems, inductive learning systems were not widely accepted in medical practice. In this paper two different approaches to machine learning in medical applications are compared: the system for inductive learning of decision trees Assistant, and the naive Bayesian classifier. Both methodologies were tested in four medical diagnostic problems: localization of primary tumor, prognostics of recurrence of breast cancer, diagnosis of thyroid diseases, and rheumatology. The accuracy of automatically acquired diagnostic knowledge from stored data records is compared, and the interpretation of the knowledge and the explanation ability of the classification process of each system is discussed. Surprisingly, the naive Bayesian classifier is superior to Assistant in classification accuracy and explanation ability, while the interpretation of the acquired knowledge seems to be equally valuable. In addition, two extensions to naive Bayesian classifier are briefly des...

[1]  J. R. Quinlan.  Discovering rules by induction from large collections of examples Intro-ductory readings in expert s , 1979 .

[2]  Luc Steels,et al.  Second-Generation Expert Systems , 1985, IEEE Expert.

[3]  Paul Compton,et al.  Inductive knowledge acquisition: a case study , 1987 .

[4]  Ivan Bratko,et al.  Learning Redundant Rules in Noisy Domains , 1988, ECAI.

[5]  Yoh-Han Pao,et al.  Adaptive pattern recognition and neural networks , 1989 .

[6]  Stephen Muggleton,et al.  Inductive acquisition of expert knowledge , 1986 .

[7]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[8]  Bojan Cestnik,et al.  Estimating Probabilities: A Crucial Task in Machine Learning , 1990, ECAI.

[9]  Jason Catlett,et al.  On Changing Continuous Attributes into Ordered Discrete Attributes , 1991, EWSL.

[10]  Igor Kononenko,et al.  Semi-Naive Bayesian Classifier , 1991, EWSL.

[11]  Katharina Morik,et al.  Machine Learning and Knowledge Acquisition, Summary of Research Contributions Presented at IJCAI'91 , 1992, AI Communications.

[12]  L. Stein,et al.  Probability and the Weighing of Evidence , 1950 .

[13]  Padhraic Smyth,et al.  A Hybrid Rule-Based/Bayesian Classifier , 1990, ECAI.

[14]  Paul W. Baim.  A Method for Attribute Selection in Inductive Learning Systems , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  W. R. Willcox,et al.  Automatic construction of diagnostic tables , 1972, Comput. J..

[16]  A. Hasman.  Kardio. A study in deep and qualitative knowledge for expert systems , 1991 .

[17]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[18]  Donald Michie,et al.  Use of sequential Bayes with class probability trees , 1991 .

[19]  Pietro Torasso,et al.  LEARNING OF FUZZY PRODUCTION RULES FOR MEDICAL DIAGNOSIS , 1993 .

[20]  Ivan Bratko,et al.  Experiments in automatic learning of medical diagnostic rules , 1984 .

[21]  I. Kononenko,et al.  An experiment in machine learning of redundant knowledge , 1991, [1991 Proceedings] 6th Mediterranean Electrotechnical Conference.

[22]  Peter Clark,et al.  Rule Induction with CN2: Some Recent Improvements , 1991, EWSL.

[23]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[24]  Nada Lavrac,et al.  The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains , 1986, AAAI.

[25]  Claude E. Shannon,et al.  A Mathematical Theory of Communications , 1948 .

[26]  Padhraic Smyth,et al.  Information-Theoretic Rule Induction , 1988, ECAI.

[27]  J. Ross Quinlan,et al.  Unknown Attribute Values in Induction , 1989, ML.

[28]  Padhraic Smyth,et al.  Rule Induction Using Information Theory , 1991, Knowledge Discovery in Databases.

[29]  I. Kononenko,et al.  Feedforward Bayesian neural network and continuous attributes , 1991, [Proceedings] 1991 IEEE International Joint Conference on Neural Networks.

[30]  J. Ross Quinlan,et al.  An Expert System for the Interpretation of Thyroid Assays in a Clinical Laboratory , 1985, Aust. Comput. J..

[31]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[32]  I. Bratko,et al.  Information-based evaluation criterion for classifier's performance , 2004, Machine Learning.