Sequential three-way classifier with justifiable granularity

Abstract Sequential three-way decisions approach has been demonstrated as an effective methodology of human problem solving with the aid of multiple levels of granularity. Searching an appropriate information granularity for decision or classification is a crucial issue. In this paper, inspired by the principle of justifiable granularity, we investigate a novel classification algorithm, called sequential three-way classifier with justifiable subspace. The major contribution of this study is threefold. First, in training model, with an investigation of the essence of information granularity in rough sets theory, the justifiable attribute subspace is located in an interval with local and global notions. Second, in light of the advantages of attribute reduction technology, the local and global attribute subspaces are determined by core and reduct, respectively. Third, a novel dynamic tri-partition-based predicting strategy is presented with the aid of neighborhood monotonic property. Finally, several experiments are undertaken to verify the effectiveness of the proposed method. Compared with several state-of-the-art classifiers, the proposed algorithm generally exhibits a better classification performance involving fewer attributes.

[1]  Hamido Fujita,et al.  Parallel attribute reduction in dominance-based neighborhood rough set , 2016, Inf. Sci..

[2]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[3]  Yiyu Yao,et al.  Generalized attribute reduct in rough set theory , 2016, Knowl. Based Syst..

[4]  Witold Pedrycz,et al.  Granular representation and granular computing with fuzzy sets , 2012, Fuzzy Sets Syst..

[5]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[6]  Xiaonan Li,et al.  Three-way decisions approach to multiple attribute group decision making with linguistic information-based decision-theoretic rough fuzzy set , 2018, Int. J. Approx. Reason..

[7]  Decui Liang,et al.  A novel three-way decision model based on incomplete information system , 2016, Knowl. Based Syst..

[8]  Yiyu Yao,et al.  A Decision Theoretic Framework for Approximating Concepts , 1992, Int. J. Man Mach. Stud..

[9]  Jian Wang,et al.  Cost-sensitive three-way recommendations by learning pair-wise preferences , 2017, Int. J. Approx. Reason..

[10]  Qinghua Hu,et al.  EROS: Ensemble rough subspaces , 2007, Pattern Recognit..

[11]  Witold Pedrycz,et al.  Shadowed sets: representing and processing fuzzy sets , 1998, IEEE Trans. Syst. Man Cybern. Part B.

[12]  Decui Liang,et al.  Three-way group decisions with decision-theoretic rough sets , 2016, Inf. Sci..

[13]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[14]  Wei-Zhi Wu,et al.  Three-way concept learning based on cognitive operators: An information fusion viewpoint , 2017, Int. J. Approx. Reason..

[15]  Yiyu Yao,et al.  A unified model of sequential three-way decisions and multilevel incremental processing , 2017, Knowl. Based Syst..

[16]  Yiyu Yao,et al.  Advances in three-way decisions and granular computing , 2016, Knowl. Based Syst..

[17]  Witold Pedrycz,et al.  Fuzzy Systems Engineering - Toward Human-Centric Computing , 2007 .

[18]  Chen Hao,et al.  Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions , 2017, Inf. Sci..

[19]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[20]  Bing Huang,et al.  Cost-sensitive rough set: A multi-granulation approach , 2017, Knowl. Based Syst..

[21]  Witold Pedrycz,et al.  Clustering Granular Data and Their Characterization With Information Granules of Higher Type , 2015, IEEE Transactions on Fuzzy Systems.

[22]  Witold Pedrycz,et al.  The Principle of Justifiable Granularity and an Optimization of Information Granularity Allocation as Fundamentals of Granular Computing , 2011, J. Inf. Process. Syst..

[23]  Witold Pedrycz,et al.  Grouping granular structures in human granulation intelligence , 2017, Inf. Sci..

[24]  Jiye Liang,et al.  International Journal of Approximate Reasoning Multigranulation Decision-theoretic Rough Sets , 2022 .

[25]  Witold Pedrycz,et al.  An efficient accelerator for attribute reduction from incomplete data in rough set framework , 2011, Pattern Recognit..

[26]  Xinye Cai,et al.  Neighborhood based decision-theoretic rough set models , 2016, Int. J. Approx. Reason..

[27]  Hamido Fujita,et al.  A visual analytics with evidential inference for big data: case study of chemical vapor deposition in solar company , 2018, Granular Computing.

[28]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[29]  Witold Pedrycz,et al.  Granular Data Aggregation: An Adaptive Principle of the Justifiable Granularity Approach , 2019, IEEE Transactions on Cybernetics.

[30]  Zeshui Xu,et al.  Three-way decisions with intuitionistic fuzzy decision-theoretic rough sets based on point operators , 2017, Inf. Sci..

[31]  Weihua Xu,et al.  Double-quantitative decision-theoretic rough set , 2015, Inf. Sci..

[32]  Witold Pedrycz,et al.  Designing Fuzzy Sets With the Use of the Parametric Principle of Justifiable Granularity , 2016, IEEE Transactions on Fuzzy Systems.

[33]  Yiyu Yao,et al.  Three-Way Decisions and Cognitive Computing , 2016, Cognitive Computation.

[34]  Guoyin Wang,et al.  Approximate concept construction with three-way decisions and attribute reduction in incomplete contexts , 2016, Knowl. Based Syst..

[35]  Qinghua Hu,et al.  A Fitting Model for Feature Selection With Fuzzy Rough Sets , 2017, IEEE Transactions on Fuzzy Systems.

[36]  Xin Yang,et al.  A unified framework of dynamic three-way probabilistic rough sets , 2017, Inf. Sci..

[37]  Weihua Xu,et al.  Double-quantitative rough fuzzy set based decisions: A logical operations method , 2017, Inf. Sci..

[38]  Andrzej Bargiela,et al.  Human-Centric Information Processing Through Granular Modelling , 2009, Human-Centric Information Processing Through Granular Modelling.

[39]  Jiye Liang,et al.  Local multigranulation decision-theoretic rough sets , 2017, Int. J. Approx. Reason..

[40]  Wei-Zhi Wu,et al.  Decision-theoretic rough set: A multicost strategy , 2016, Knowl. Based Syst..

[41]  Zeshui Xu,et al.  Three-way decisions based on decision-theoretic rough sets with dual hesitant fuzzy information , 2017, Inf. Sci..

[42]  Fan Min,et al.  Three-way recommender systems based on random forests , 2016, Knowl. Based Syst..

[43]  Guangming Lang,et al.  Three-way decision approaches to conflict analysis using decision-theoretic rough set theory , 2017, Inf. Sci..

[44]  Witold Pedrycz,et al.  Determining Three-Way Decisions With Decision-Theoretic Rough Sets Using a Relative Value Approach , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Bing Huang,et al.  Cost-sensitive sequential three-way decision modeling using a deep neural network , 2017, Int. J. Approx. Reason..

[46]  Jing-Yu Yang,et al.  Multi-label learning with label-specific feature reduction , 2016, Knowl. Based Syst..

[47]  Bing Shi,et al.  Regression-based three-way recommendation , 2017, Inf. Sci..

[48]  Yuhua Qian,et al.  Concept learning via granular computing: A cognitive viewpoint , 2014, Information Sciences.

[49]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[50]  Jingtao Yao,et al.  Modelling Multi-agent Three-way Decisions with Decision-theoretic Rough Sets , 2012, Fundam. Informaticae.

[51]  Yuhua Qian,et al.  Three-way cognitive concept learning via multi-granularity , 2017, Inf. Sci..

[52]  Witold Pedrycz,et al.  Three-way decisions based on decision-theoretic rough sets under linguistic assessment with the aid of group decision making , 2015, Appl. Soft Comput..

[53]  Witold Pedrycz,et al.  Granular computing: an introduction , 2001, Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569).

[54]  Nan Zhang,et al.  Attribute reduction for sequential three-way decisions under dynamic granulation , 2017, Int. J. Approx. Reason..

[55]  Weihua Xu,et al.  Generalized multigranulation double-quantitative decision-theoretic rough set , 2016, Knowl. Based Syst..

[56]  Jingtao Yao,et al.  Gini objective functions for three-way classifications , 2017, Int. J. Approx. Reason..

[57]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[58]  Qing Li,et al.  Three-way decisions based software defect prediction , 2016, Knowl. Based Syst..

[59]  Xia Xiao,et al.  Three-way group decision making based on multigranulation fuzzy decision-theoretic rough set over two universes , 2017, Int. J. Approx. Reason..

[60]  A. V. Savchenko,et al.  Fast multi-class recognition of piecewise regular objects based on sequential three-way decisions and granular computing , 2016, Knowl. Based Syst..

[61]  Guoyin Wang,et al.  Three-way decision model with two types of classification errors , 2017, Inf. Sci..

[62]  Zdzislaw Pawlak,et al.  Rough Set Theory and its Applications to Data Analysis , 1998, Cybern. Syst..

[63]  Koen Vanhoof,et al.  Fuzzy-Rough Cognitive Networks , 2018, Neural Networks.

[64]  Jing-Yu Yang,et al.  Cost-sensitive rough set approach , 2016, Inf. Sci..

[65]  Witold Pedrycz,et al.  From numeric data to information granules: A design through clustering and the principle of justifiable granularity , 2016, Knowl. Based Syst..

[66]  Zhenmin Tang,et al.  Minimum cost attribute reduction in decision-theoretic rough set models , 2013, Inf. Sci..

[67]  Fan Min,et al.  Tri-partition cost-sensitive active learning through kNN , 2017, Soft Computing.

[68]  Qinghua Hu,et al.  Cost-sensitive feature selection based on adaptive neighborhood granularity with multi-level confidence , 2016, Inf. Sci..

[69]  Yiyu Yao,et al.  Constructing shadowed sets and three-way approximations of fuzzy sets , 2017, Inf. Sci..

[70]  Witold Pedrycz,et al.  Building the fundamentals of granular computing: A principle of justifiable granularity , 2013, Appl. Soft Comput..

[71]  Zhenmin Tang,et al.  On an optimization representation of decision-theoretic rough set model , 2014, Int. J. Approx. Reason..