Covering rough set-based three-way decision feature selection

Feature selection is the process of selecting a subset of features from the entire dataset such that the selected subset can be used on behalf of the entire features of dataset to reduce the complexity of further processing. Recently, many feature selection approaches have been developed effectively based on rough sets. To provide a reasonable semantic interpretation for the three regions of probability rough sets and decision theoretic rough sets, the three-way decision theory is proposed. By using of the covering rough set model, the positive region, boundary region and negative region of the three-way decision approach are established to conduct feature selection. In this paper, the covering rough set-based three-way decision feature selection method (CTFS) is proposed to extend the traditional rough set version. Furthermore, the condition entropy based on three-way decision regions can be used as an evaluation method to select features. The experimental results show that the proposed feature selection approach results in a smaller selected feature subsets compared to the state-of-the-art feature selection methods with higher classification accuracies.

[1]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[2]  Mengjie Zhang,et al.  A Dimension Reduction Approach to Classification Based on Particle Swarm Optimisation and Rough Set Theory , 2012, Australasian Conference on Artificial Intelligence.

[3]  Qinghua Hu,et al.  A new approach to attribute reduction of consistent and inconsistent covering decision systems with covering rough sets , 2007, Inf. Sci..

[4]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[6]  Mengjie Zhang,et al.  A Multi-objective Feature Selection Approach Based on Binary PSO and Rough Set Theory , 2013, EvoCOP.

[7]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[8]  Mengjie Zhang,et al.  Binary particle swarm optimisation and rough set theory for dimension reduction in classification , 2013, 2013 IEEE Congress on Evolutionary Computation.

[9]  Mengjie Zhang,et al.  Binary PSO and Rough Set Theory for Feature Selection: a Multi-objective filter Based Approach , 2014, Int. J. Comput. Intell. Appl..

[10]  Gianpiero Cattaneo,et al.  Abstract Approximation Spaces for Rough Theories , 2008 .

[11]  Lindsay I. Smith,et al.  A tutorial on Principal Components Analysis , 2002 .

[12]  Mark A. Hall,et al.  Correlation-based Feature Selection for Machine Learning , 2003 .

[13]  Jane Labadin,et al.  Feature selection based on mutual information , 2015, 2015 9th International Conference on IT in Asia (CITA).

[14]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[15]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[16]  Chen Degang,et al.  A new approach to attribute reduction of consistent and inconsistent covering decision systems with covering rough sets , 2007 .

[17]  William Zhu,et al.  On Three Types of Covering-Based Rough Sets , 2014, IEEE Transactions on Knowledge and Data Engineering.

[18]  Yumin Chen,et al.  Three-way decision reduction in neighborhood systems , 2016, Appl. Soft Comput..

[19]  Yiyu Yao,et al.  An Outline of a Theory of Three-Way Decisions , 2012, RSCTC.

[20]  Qiang Shen,et al.  New Approaches to Fuzzy-Rough Feature Selection , 2009, IEEE Transactions on Fuzzy Systems.

[21]  Theresa Beaubouef,et al.  Rough Sets , 2019, Lecture Notes in Computer Science.

[22]  Wei Wu,et al.  Fuzzy similarity-based nearest-neighbour classification as alternatives to their fuzzy-rough parallels , 2013, Int. J. Approx. Reason..

[23]  Jiye Liang,et al.  Multigranulation rough sets: From partition to covering , 2013, Inf. Sci..

[24]  Mengjie Zhang,et al.  Feature selection based on PSO and decision-theoretic rough set model , 2013, 2013 IEEE Congress on Evolutionary Computation.

[25]  Degang Chen,et al.  Fuzzy rough set theory for the interval-valued fuzzy information systems , 2008, Inf. Sci..

[26]  Yiyu Yao,et al.  Covering based rough set approximations , 2012, Inf. Sci..