Rule Mining Based on Nonmonotonic Rule Layers and Its Application to Medicine

This paper proposes a new framework for rule induction methods based on rule layers constrained by inequalities of accuracy and coverage. Rule layers consists of (regular) rule layer, in subrule layer out subrule layer, and non-rule layer. Since the rules can be classified into one of the layers by the inequalities, updates of probabilistic rules are equivalent to their movement between layers. Rule induction methods are combined with classification of elementary relations (i.e., one attribute-value pair) into four layers. The classification statistics reflects the characteristics of data and rule stabilities. The proposed method was evaluated on datasets regarding headaches and meningitis, and the results show that the proposed method not only outperforms the conventional method but also captures the characteristics of applied data.

[1]  Ryszard S. Michalski,et al.  A theory and methodology of inductive learning , 1993 .

[2]  Shusaku Tsumoto Formalization and Induction of Medical Expert System Rules Based on Rough Set Theory , 1998 .

[3]  Ivan Bratko,et al.  ASSISTANT 86: A Knowledge-Elicitation Tool for Sophisticated Users , 1987, EWSL.

[4]  Shusaku Tsumoto,et al.  Automated Extraction of Medical Expert System Rules from Clinical Databases on Rough Set Theory , 1998, Inf. Sci..

[5]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[6]  Paul E. Utgoff,et al.  Incremental Induction of Decision Trees , 1989, Machine Learning.

[7]  Salvatore Greco,et al.  Analysis of Symmetry Properties for Bayesian Confirmation Measures , 2012, RSKT.

[8]  Peter Clark,et al.  The CN2 induction algorithm , 2004, Machine Learning.

[9]  Wojciech Ziarko,et al.  DATA‐BASED ACQUISITION AND INCREMENTAL MODIFICATION OF CLASSIFICATION RULES , 1995, Comput. Intell..

[10]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[11]  Shusaku Tsumoto,et al.  Knowledge discovery in clinical databases and evaluation of discovered knowledge in outpatient clinic , 2000, Inf. Sci..

[12]  Hiroshi Tanaka,et al.  PRIMEROSE: PROBABILISTIC RULE INDUCTION METHOD BASED ON ROUGH SETS AND RESAMPLING METHODS , 1995, Comput. Intell..

[13]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[14]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[15]  Zdzisław Pawlak,et al.  Can Bayesian confirmation measures be useful for rough set decision rules? , 2004, Eng. Appl. Artif. Intell..

[16]  Shusaku Tsumoto,et al.  Risk Mining in Medicine: Application of Data Mining to Medical Risk Management , 2010, Fundam. Informaticae.

[17]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[18]  Nada Lavrac,et al.  The Multi-Purpose Incremental Learning System AQ15 and Its Testing Application to Three Medical Domains , 1986, AAAI.

[19]  Shusaku Tsumoto Incremental Rule Induction Based on Rough Set Theory , 2011, ISMIS.

[20]  Shusaku Tsumoto,et al.  Incremental Rules Induction Based on Rule Layers , 2012, RSKT.