Multiple Reducts Computation in Rough Sets with Applications to Ensemble Classification

Rough set theory has emerged as an influential soft-computing approach for feature subset selection (reduct computation) in the decision system amidst incompleteness and inconsistency. Multiple reducts computation using rough sets provide an elegant way for construction of ensemble classifier for better and stable classification. The existing approaches for multiple reducts computation are primarily based on the genetic algorithm and select diverse multiple reducts after generation of abundant candidate reducts. This work proposes an MRGA_MRC algorithm for multiple reducts computation by utilizing the systematically evolving search space of all reducts computation in the MRGA algorithm without generation of many candidate reducts. A novel heuristic is introduced for selection of diverse multiple reducts. Experiments conducted on the benchmark decision systems have established the relevance of the proposed approach in comparison to the genetic algorithm based multiple reducts computation approach REUCS.

[1]  Kathryn E. Merrick,et al.  Reduct based ensemble of learning classifier system for real-valued classification problems , 2013, 2013 IEEE Symposium on Computational Intelligence and Ensemble Learning (CIEL).

[2]  Wang Ju,et al.  Reduction algorithms based on discernibility matrix: The ordered attributes method , 2001, Journal of Computer Science and Technology.

[3]  Rajen B. Bhatt,et al.  On the compact computational domain of fuzzy-rough sets , 2005, Pattern Recognit. Lett..

[4]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[5]  Hong Shi,et al.  Discernibility Matrix-Based Ensemble Learning , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[6]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.

[7]  Tsau Young Lin,et al.  Rough Sets and Data Mining: Analysis of Imprecise Data , 1996 .

[8]  Qingxiang Wu,et al.  Multiknowledge for decision making , 2005, Knowledge and Information Systems.

[9]  Jiye Liang,et al.  The Information Entropy, Rough Entropy And Knowledge Granulation In Rough Set Theory , 2004, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[10]  Nick Cercone,et al.  Generation of Multiple Knowledge from Databases Based on Rough Sets Theory , 1997 .

[11]  C. Raghavendra Rao,et al.  IQuickReduct: An Improvement to Quick Reduct Algorithm , 2009, RSFDGrC.

[12]  Robert P. W. Duin,et al.  An experimental study on diversity for bagging and boosting with linear classifiers , 2002, Inf. Fusion.

[13]  Yiyu Yao,et al.  Ensemble selector for attribute reduction , 2018, Appl. Soft Comput..

[14]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[15]  Robert Susmaga Parallel Computation of Reducts , 1998, Rough Sets and Current Trends in Computing.

[16]  T. Y. Lin,et al.  Rough Sets and Data Mining , 1997, Springer US.

[17]  Jan G. Bazan,et al.  Rough set algorithms in classification problem , 2000 .

[18]  D. A. Bell,et al.  Rough Computational Methods for Information , 1998, Artif. Intell..

[19]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[20]  Moacir P. Ponti,et al.  Combining Classifiers: From the Creation of Ensembles to the Decision Fusion , 2011, SIBGRAPI Tutorials.

[21]  Zied Elouedi,et al.  Ensemble Enhanced Evidential k-NN Classifier Through Rough Set Reducts , 2018, IPMU.

[22]  Theresa Beaubouef,et al.  Information-Theoretic Measures of Uncertainty for Rough Sets and Rough Relational Databases , 1998, Inf. Sci..

[23]  Xin Pan,et al.  Ensemble remote sensing classifier based on rough set theory and genetic algorithm , 2010, 2010 18th International Conference on Geoinformatics.

[24]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[25]  William W. Cohen Fast Effective Rule Induction , 1995, ICML.

[26]  Yasuo Kudo,et al.  A sequential pattern mining algorithm using rough set theory , 2011, Int. J. Approx. Reason..

[27]  Lei Xi,et al.  Rough set based ensemble learning algorithm for agricultural data classification , 2018 .

[28]  Hung Son Nguyen,et al.  Approximate Boolean Reasoning: Foundations and Applications in Data Mining , 2006, Trans. Rough Sets.

[29]  Jaya Sil,et al.  An efficient classifier design integrating rough set and set oriented database operations , 2011, Appl. Soft Comput..