Evaluating a Constructive Meta-learning Algorithm for a Rule Evaluation Support Method Based on Objective Indices

In this paper, we present an evaluation of learning algorithms to select proper ones in a rule evaluation support tool for post-processing of mined results. Post-processing of mined results is one of the key processes in the data mining process. However, it is difficult for human experts to completely evaluate several thousand of rules from a large dataset with noises. To reduce the costs in such a rule evaluation task, we have developed a rule evaluation support method with rule evaluation models, which learn from objective indices for mined classification rules and evaluations by a human expert for each rule. To enhance the adaptability of rule evaluation models, we introduced a constructive meta-learning system to choose proper learning algorithms. Then, we performed the case study on the meningitis data mining as an actual problem. The obtained results demonstrate the applicability of the proposed rule evaluation support method.

[1]  João Gama,et al.  Cascade Generalization , 2000, Machine Learning.

[2]  Ning Zhong,et al.  Methodologies for Knowledge Discovery and Data Mining , 2002, Lecture Notes in Computer Science.

[4]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[5]  Dino Pedreschi,et al.  Knowledge Discovery in Databases: PKDD 2004 , 2004, Lecture Notes in Computer Science.

[6]  Moonis Ali,et al.  Innovations in Applied Artificial Intelligence , 2005 .

[7]  David H. Wolpert,et al.  Stacked generalization , 1992, Neural Networks.

[8]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[9]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[10]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[11]  Abraham Bernstein,et al.  An Intelligent Assistant for the Knowledge Discovery Process , 2001, IJCAI 2001.

[12]  Jaideep Srivastava,et al.  Selecting the right interestingness measure for association patterns , 2002, KDD.

[13]  Yiyu Yao,et al.  An Analysis of Quantitative Measures Associated with Rules , 1999, PAKDD.

[14]  Howard J. Hamilton,et al.  Knowledge discovery and measures of interest , 2001 .

[15]  Robert C. Holte,et al.  Very Simple Classification Rules Perform Well on Most Commonly Used Datasets , 1993, Machine Learning.

[16]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[17]  D.E. Goldberg,et al.  Classifier Systems and Genetic Algorithms , 1989, Artif. Intell..

[18]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques with Java implementations , 2002, SGMD.

[19]  Takahira Yamaguchi,et al.  Constructive meta-learning with machine learning method repositories , 2004 .

[20]  Yong Wang,et al.  Using Model Trees for Classification , 1998, Machine Learning.

[21]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[22]  Takahira Yamaguchi,et al.  Evaluation of Rule Interestingness Measures with a Clinical Dataset on Hepatitis , 2004, PKDD.

[23]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[24]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.