Restructuring decision tables for elucidation of knowledge

Decision tables are widely used in many knowledge-based and decision support systems. They allow relatively complex logical relationships to be represented in an easily understood form and processed efficiently. This paper describes second-order decision tables (decision tables that contain rows whose components have sets of atomic values) and their role in knowledge engineering to: (1) support efficient management and enhance comprehensibility of tabular knowledge acquired by knowledge engineers, and (2) automatically generate knowledge from a tabular set of examples. We show how second-order decision tables can be used to restructure acquired tabular knowledge into a condensed but logically equivalent second-order table. We then present the results of experiments with such restructuring. Next, we describe SORCER, a learning system that induces second-order decision tables from a given database. We compare SORCER with IDTM, a system that induces standard decision tables, and a state-of-the-art decision tree learner, C4.5. Results show that in spite of its simple induction methods, on the average over the data sets studied, SORCER has the lowest error rate.

[1]  Ishwar K. Sethi,et al.  Conversion of decision tables to efficient sequential testing procedures , 1980, CACM.

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Wojciech Ziarko,et al.  The Discovery, Analysis, and Representation of Data Dependencies in Databases , 1991, Knowledge Discovery in Databases.

[4]  William Frawley,et al.  Knowledge Discovery in Databases , 1991 .

[5]  Lois M. L. Delcambre,et al.  RPL: An expert system language with query power , 1988, IEEE Expert.

[6]  Michael J. Pazzani,et al.  Guideline generation from data by induction of decision tables using a Bayesian network framework , 1998, AMIA.

[7]  Saburo Muroga,et al.  Absolute Minimization of Completely Specified Switching Functions , 1991, IEEE Trans. Computers.

[8]  Geert Wets,et al.  From Decision Tables to Expert System Shells , 1994, Data Knowl. Eng..

[9]  Chidanand Apté,et al.  Predicting Equity Returns from Securities Data , 1996, Advances in Knowledge Discovery and Data Mining.

[10]  Rattikorn Hewett,et al.  Knowledge Discovery with Second-Order Relations , 2002, Knowledge and Information Systems.

[11]  Rattikorn Hewett,et al.  From climate history to prediction of regional water flows with machine learning , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[12]  Olivier Coudert,et al.  Two-level logic minimization: an overview , 1994, Integr..

[13]  Robert M. Colomb,et al.  Very Fast Decision Table Execution of Propositional Expert Systems , 1990, AAAI.

[14]  Maciej Modrzejewski,et al.  Feature Selection Using Rough Sets Theory , 1993, ECML.

[15]  J. Shearer,et al.  Prime Implicants, Minimum Covers, and the Complexity of Logic Simplification , 1986, IEEE Transactions on Computers.

[16]  Jan Vanthienen,et al.  Illustration of a Decision Table Tool for Specifying and Implementing Knowledge Based Systems , 1994, Int. J. Artif. Intell. Tools.

[17]  David Martin,et al.  Book review: The Engineering of Knowledge-based Systems Theory and Practice by Avelino J. Gonzales and Douglas D. Dankel (Prentice Hall, 1993) , 1993, SGAR.

[18]  Ron Kohavi,et al.  MLC++: a machine learning library in C++ , 1994, Proceedings Sixth International Conference on Tools with Artificial Intelligence. TAI 94.

[19]  Chris Culbert,et al.  State-of-the-practice in knowledge-based system verification and validation , 1991 .

[20]  Alberto L. Sangiovanni-Vincentelli,et al.  Multiple-Valued Minimization for PLA Optimization , 1987, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[21]  Avelino J. Gonzalez,et al.  The Engineering of Knowledge-Based Systems , 1993 .

[22]  Michael J. Darnell,et al.  Empirical evaluation of decision tables for constructing and comprehending expert system rules , 1992 .

[23]  Jan Vanthienen,et al.  Knowledge acquisition and validation using a decision table engineering workbench , 1991 .

[24]  Pat Langley,et al.  Induction of Condensed Determinations , 1996, KDD.

[25]  Jay Liebowitz,et al.  The World Congress on Expert Systems , 1992 .

[26]  Harold J. Steudel,et al.  A Decision-Table-Based Processor for Checking Completeness and Consistency in Rule-Based Expert Systems , 1987, Int. J. Man Mach. Stud..

[27]  Kurt Keutzer,et al.  Logic Synthesis , 1994 .

[28]  R. Słowiński.  Intelligent Decision Support: Handbook of Applications and Advances of the Rough Sets Theory , 1992 .

[29]  Daniel L. Ostapko,et al.  MINI: A Heuristic Approach for Logic Minimization , 1974, IBM J. Res. Dev..

[30]  Ron Kohavi,et al.  The Power of Decision Tables , 1995, ECML.

[31]  Art Lew,et al.  Optimal conversion of extended-entry decision tables with general cost criteria , 1978, CACM.

[32]  Ron Kohavi,et al.  Targeting Business Users with Decision Table Classifiers , 1998, KDD.

[33]  Daniel S. Hirschberg,et al.  Average case analysis of k -CNF and k -DNF learning algorithms , 1994, COLT 1994.

[34]  Patrick C. Fischer,et al.  Nested Relational Structures , 1986, Adv. Comput. Res..

[35]  Henrik Legind Larsen,et al.  Detection of potential inconsistencies in knowledge bases , 1992, Int. J. Intell. Syst..

[36]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[37]  Michael Goul,et al.  Validating expert systems , 1990, IEEE Expert.

[38]  Robert C. Holte,et al.  Very Simple Classification Rules Perform Well on Most Commonly Used Datasets , 1993, Machine Learning.

[39]  Girish H. Subramanian,et al.  A comparison of the decision table and tree , 1992, CACM.

[40]  E. McCluskey.  Minimization of Boolean functions , 1956 .