A New Probabilistic Induction Method

Knowledge acquisition by interviewing a domain expert is one of the most problematic aspects of the development of expert systems. As an alternative, methods for inducing concept descriptions from examples have proven useful in eliminating this bottleneck. In this paper, we propose a probabilistic induction method (PIM), which is an improvement of the Chan and Wong method, for detecting relevant patterns implicit in a given data set. PIM uses the technique of residual analysis and several heuristics to effectively detect complex relevant patterns and to avoid the problem of combinatorial explosion. A reasonable trade-off between the induction time and the classification ratio is achieved. Moreover, PIM quickly classifies unknown objects using classification rules converted from the positively relevant patterns detected. Three experiments are conducted to confirm the validity of PIM.

[1]  Tzung-Pei Hong,et al.  Learning Concepts in Parallel Based upon the Strategy of Version Space , 1994, IEEE Trans. Knowl. Data Eng..

[2]  S. Haberman.  The Analysis of Residuals in Cross-Classified Tables , 1973 .

[3]  Andrew K. C. Wong,et al.  Performance Analysis of a Probabilistic Inductive Learning System , 1990, ML.

[4]  David A. Landgrebe,et al.  A survey of decision tree classifier methodology , 1991, IEEE Trans. Syst. Man Cybern..

[5]  Horst Bunke,et al.  An expert system for the selection and application of image processing subroutines , 1993 .

[6]  Ryszard S. Michalski,et al.  Machine learning: an artificial intelligence approach volume III , 1990 .

[7]  John Mingers,et al.  An Empirical Comparison of Selection Measures for Decision-Tree Induction , 1989, Machine Learning.

[8]  J. Ross Quinlan,et al.  Learning Efficient Classification Procedures and Their Application to Chess End Games , 1983 .

[9]  J. Ross Quinlan,et al.  Simplifying decision trees , 1987, Int. J. Hum. Comput. Stud..

[10]  John R. Anderson,et al.  MACHINE LEARNING An Artificial Intelligence Approach , 2009 .

[11]  John Mingers,et al.  An Empirical Comparison of Pruning Methods for Decision Tree Induction , 1989, Machine Learning.

[12]  Ian H. Witten,et al.  Using Concept Learning for Knowledge Acquisition , 1988, Int. J. Man Mach. Stud..

[13]  Padhraic Smyth,et al.  An Information Theoretic Approach to Rule Induction from Databases , 1992, IEEE Trans. Knowl. Data Eng..

[14]  David M. Miller,et al.  An expert system for wide area network component configuration , 1992 .

[15]  A. Gisolfi,et al.  Constructing and consulting the knowledge base of an expert systems shell , 1993 .

[16]  Jadzia Cendrowska,et al.  PRISM: An Algorithm for Inducing Modular Rules , 1987, Int. J. Man Mach. Stud..

[17]  Shian-Shyong Tseng,et al.  A brain tumor diagnostic system with automatic learning abilities , 1990, [1990] Proceedings. Third Annual IEEE Symposium on Computer-Based Medical Systems.

[18]  Peter Clark,et al.  The CN2 Induction Algorithm , 1989, Machine Learning.