Three-way decision reduction in neighborhood systems

HighlightsWe define the three-way decision reducts of positive region preservation, boundary region preservation and negative region preservation with the neighborhood rough set model.Three condition entropy measures are constructed based on three-way decision regions by considering variants of neighborhood classes.The monotonic principles of entropy measures are proved, from which we can obtain the heuristic reduction algorithms in neighborhood systems. Rough set reduction has been used as an important preprocessing tool for pattern recognition, machine learning and data mining. As the classical Pawlak rough sets can just be used to evaluate categorical features, a neighborhood rough set model is introduced to deal with numerical data sets. Three-way decision theory proposed by Yao comes from Pawlak rough sets and probability rough sets for trading off different types of classification error in order to obtain a minimum cost ternary classifier. In this paper, we discuss reduction questions based on three-way decisions and neighborhood rough sets. First, the three-way decision reducts of positive region preservation, boundary region preservation and negative region preservation are introduced into the neighborhood rough set model. Second, three condition entropy measures are constructed based on three-way decision regions by considering variants of neighborhood classes. The monotonic principles of entropy measures are proved, from which we can obtain the heuristic reduction algorithms in neighborhood systems. Finally, the experimental results show that the three-way decision reduction approaches are effective feature selection techniques for addressing numerical data sets.

[1]  Kan Zheng,et al.  Three-Way Decisions Solution to Filter Spam Email: An Empirical Study , 2012, RSCTC.

[2]  Qinghua Hu,et al.  Information-preserving hybrid data reduction based on fuzzy-rough techniques , 2006, Pattern Recognit. Lett..

[3]  Yiyu Yao,et al.  Probabilistic approaches to rough sets , 2003, Expert Syst. J. Knowl. Eng..

[4]  Qiong Zhang,et al.  Rough Rule Extracting From Various Conditions: Incremental and Approximate Approaches for Inconsistent Data , 2008, Fundam. Informaticae.

[5]  James F. Peters,et al.  Tolerance spaces: Origins, theoretical aspects and applications , 2012, Inf. Sci..

[6]  Yiyu Yao,et al.  Constructive and Algebraic Methods of the Theory of Rough Sets , 1998, Inf. Sci..

[7]  Salvatore Greco,et al.  Rough approximation by dominance relations , 2002, Int. J. Intell. Syst..

[8]  Dominik Slezak,et al.  Approximate Entropy Reducts , 2002, Fundam. Informaticae.

[9]  D. Dubois,et al.  ROUGH FUZZY SETS AND FUZZY ROUGH SETS , 1990 .

[10]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[11]  Tsau Young Lin,et al.  First GrC model - Neighborhood Systems the most general rough set models , 2009, 2009 IEEE International Conference on Granular Computing.

[12]  Daniel Vanderpooten,et al.  A Generalized Definition of Rough Approximations Based on Similarity , 2000, IEEE Trans. Knowl. Data Eng..

[13]  Yiyu Yao,et al.  A Decision Theoretic Framework for Approximating Concepts , 1992, Int. J. Man Mach. Stud..

[14]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[15]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[16]  Fei-Yue Wang,et al.  Properties of the Fourth Type of Covering-Based Rough Sets , 2006, 2006 Sixth International Conference on Hybrid Intelligent Systems (HIS'06).

[17]  Tuan-Fang Fan,et al.  Dominance-based fuzzy rough set analysis of uncertain and possibilistic data tables , 2011, Int. J. Approx. Reason..

[18]  Bao Qing Hu,et al.  Three-way decisions space and three-way decisions , 2014, Inf. Sci..

[19]  William Zhu,et al.  Relationship among basic concepts in covering-based rough sets , 2009, Inf. Sci..

[20]  Yiyu Yao,et al.  Probabilistic rough set approximations , 2008, Int. J. Approx. Reason..

[21]  Heung Wong,et al.  Generalized Interval-Valued Fuzzy Rough Sets Based on Interval-Valued Fuzzy Logical Operators , 2013 .

[22]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[23]  Wojciech Ziarko,et al.  Variable Precision Rough Sets with Asymmetric Bounds , 1993, RSKD.

[24]  Duoqian Miao,et al.  Reduction target structure-based hierarchical attribute reduction for two-category decision-theoretic rough sets , 2014, Inf. Sci..

[25]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[26]  Dominik Slezak,et al.  The investigation of the Bayesian rough set model , 2005, Int. J. Approx. Reason..

[27]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[28]  Min Chen,et al.  Rough Cluster Quality Index Based on Decision Theory , 2009, IEEE Transactions on Knowledge and Data Engineering.

[29]  Yiyu Yao,et al.  The superiority of three-way decisions in probabilistic rough set models , 2011, Inf. Sci..

[30]  Xuhui Chen,et al.  An entropy-based uncertainty measurement approach in neighborhood systems , 2014, Inf. Sci..

[31]  Qinghua Hu,et al.  Mixed feature selection based on granulation and approximation , 2008, Knowl. Based Syst..

[32]  Chengqi Zhang,et al.  An information filtering model on the Web and its application in JobAgent , 2000, Knowl. Based Syst..

[33]  Yiyu Yao,et al.  Three-way Investment Decisions with Decision-theoretic Rough Sets , 2011, Int. J. Comput. Intell. Syst..

[34]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[35]  Degang Chen,et al.  Fuzzy rough set theory for the interval-valued fuzzy information systems , 2008, Inf. Sci..

[36]  Caihui Liu,et al.  Hierarchical attribute reduction algorithms for big data using MapReduce , 2015, Knowl. Based Syst..

[37]  Yao Ping,et al.  Neighborhood rough set and SVM based hybrid credit scoring classifier , 2011 .

[38]  Yiyu Yao,et al.  A Comparative Study of Fuzzy Sets and Rough Sets , 1998 .

[39]  Yiyu Yao,et al.  A Note on Attribute Reduction in the Decision-Theoretic Rough Set Model , 2008, RSCTC.

[40]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..

[41]  Guoyin Wang,et al.  Decision region distribution preservation reduction in decision-theoretic rough set model , 2014, Inf. Sci..

[42]  Nan Zhang,et al.  Hierarchical rough decision theoretic framework for text classification , 2010, 9th IEEE International Conference on Cognitive Informatics (ICCI'10).

[43]  Da Ruan,et al.  Probabilistic model criteria with decision-theoretic rough sets , 2011, Inf. Sci..

[44]  Wang Guo,et al.  Decision Table Reduction based on Conditional Information Entropy , 2002 .

[45]  Wojciech Ziarko,et al.  Variable Precision Rough Set Model , 1993, J. Comput. Syst. Sci..

[46]  Miao Duo,et al.  A HEURISTIC ALGORITHM FOR REDUCTION OF KNOWLEDGE , 1999 .

[47]  Witold Pedrycz,et al.  Selecting Discrete and Continuous Features Based on Neighborhood Decision Error Minimization , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[48]  Jiye Liang,et al.  The Algorithm on Knowledge Reduction in Incomplete Information Systems , 2002, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[49]  Qinghua Hu,et al.  Fuzzy Probabilistic Approximation Spaces and Their Information Measures , 2006, IEEE Trans. Fuzzy Syst..

[50]  Tianrui Li,et al.  THREE-WAY GOVERNMENT DECISION ANALYSIS WITH DECISION-THEORETIC ROUGH SETS , 2012 .

[51]  Andrzej Skowron,et al.  The Discernibility Matrices and Functions in Information Systems , 1992, Intelligent Decision Support.