Dynamic Ensemble of Rough Set Reducts for Data Classification

Ensemble learning also named ensemble of multiple classifiers is one of the hot topics in machine learning. Ensemble learning can improve not only the accuracy but also the efficiency of the classification system. Constructing the component classifiers in ensemble learning is crucial, because it has direct influence on the performance of the classification system. In the construction of component classifiers, it should be guaranteed that the constructed component classifiers possess certain accuracy and diversity. Based on the confidence degree of classifier, this paper presents an approach consisting of three steps to dynamically integrate rough set reducts. Firstly, multiple reducts are computed. Secondly, multiple component classifiers with certain diversity are trained on the different reducts. Finally, these component classifiers are integrated by adopting dynamic integration strategy. The experimental results show that the proposed algorithm is efficient and feasible.

[1]  Robert Sabourin,et al.  From dynamic classifier selection to dynamic ensemble selection , 2008, Pattern Recognit..

[2]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[3]  Qinghua Hu,et al.  EROS: Ensemble rough subspaces , 2007, Pattern Recognit..

[4]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[6]  Ivo Düntsch,et al.  Uncertainty Measures of Rough Set Prediction , 1998, Artif. Intell..

[7]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Nojun Kwak,et al.  Feature extraction for classification problems and its application to face recognition , 2008, Pattern Recognit..

[9]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.

[10]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[11]  Kevin W. Bowyer,et al.  Combination of Multiple Classifiers Using Local Accuracy Estimates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[13]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[14]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[15]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.