A novel sequential three-way decisions model based on penalty function

Abstract In the sequential three-way decisions (S3WD) model, classification accuracy is an important issue. Based on the idea of minimum misclassification, loss functions have been used to calculate the thresholds. A lot of achievements have been achieved in the related research by using the idea of minimum misclassification. However, few researchers have focused on minimizing the misclassification by improving the classification precision in different granularity layers. In this paper, from the classification precision difference between two adjacent granularity layers, a new sequential three-way decisions model based on penalty function (S3WDPF) is proposed to improve the classification accuracy by modifying cost parameters. First, two types of negative benefit classification in the S3WD model are defined. Next, based on the idea of optimization, the penalty function is devised to optimize the cost parameters. Then, from the viewpoint of Bayesian minimum risk decision, a decision rule of mutually exclusive decision thresholds is designed, and the rules of three-way decisions are deduced. Further, the change rules of decision thresholds after modifying cost parameters are discussed in detail. Finally, the experimental results show that the performance of the S3WDPF model has improved classification accuracy compared with the current existing models.

[1]  Yiyu Yao,et al.  MGRS: A multi-granulation rough set , 2010, Inf. Sci..

[2]  Swagatam Das,et al.  A Fuzzy Rule-Based Penalty Function Approach for Constrained Evolutionary Optimization , 2016, IEEE Transactions on Cybernetics.

[3]  Guoyin Wang,et al.  A general model of decision-theoretic three-way approximations of fuzzy sets based on a heuristic algorithm , 2020, Inf. Sci..

[4]  Yiyu Yao,et al.  Three-Way Decisions and Cognitive Computing , 2016, Cognitive Computation.

[5]  Angelo Gaeta,et al.  Hypotheses Analysis and Assessment in Counterterrorism Activities: A Method Based on OWA and Fuzzy Probabilistic Rough Sets , 2020, IEEE Transactions on Fuzzy Systems.

[6]  Witold Pedrycz,et al.  Granular Computing: Perspectives and Challenges , 2013, IEEE Transactions on Cybernetics.

[7]  Yiyu Yao,et al.  Sequential three-way decisions with probabilistic rough sets , 2011, IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11).

[8]  Decui Liang,et al.  Three-way decisions in ordered decision system , 2017, Knowl. Based Syst..

[9]  Guoyin Wang,et al.  Optimal granularity selection based on cost-sensitive sequential three-way decisions with rough fuzzy sets , 2019, Knowl. Based Syst..

[10]  Witold Pedrycz,et al.  Granular description of data: Building information granules with the aid of the principle of justifiable granularity , 2016, 2016 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[11]  Qinghua Hu,et al.  Multi-label feature selection with streaming labels , 2016, Inf. Sci..

[12]  Decui Liang,et al.  Three-Way Decisions in Dynamic Decision-Theoretic Rough Sets , 2013, RSKT.

[13]  Lorenzo Bruzzone,et al.  Hyperspectral Band Selection Based on Rough Set , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Jinhai Li,et al.  Parallel computing techniques for concept-cognitive learning based on granular computing , 2018, International Journal of Machine Learning and Cybernetics.

[15]  Witold Pedrycz,et al.  Three-way decisions based on decision-theoretic rough sets under linguistic assessment with the aid of group decision making , 2015, Appl. Soft Comput..

[16]  Jingtao Yao,et al.  Game-Theoretic Rough Sets , 2011, Fundam. Informaticae.

[17]  Yiyu Yao,et al.  Structured approximations as a basis for three-way decisions in rough set theory , 2019, Knowl. Based Syst..

[18]  Xin Yang,et al.  A temporal-spatial composite sequential approach of three-way granular computing , 2019, Inf. Sci..

[19]  Tianrui Li,et al.  Composite Sequential Three-Way Decisions , 2018, IJCSR.

[20]  Yiyu Yao,et al.  A unified model of sequential three-way decisions and multilevel incremental processing , 2017, Knowl. Based Syst..

[21]  Ling Wei,et al.  The connections between three-way and classical concept lattices , 2016, Knowl. Based Syst..

[22]  Ali Selamat,et al.  Systematic mapping study on granular computing , 2015, Knowl. Based Syst..

[23]  Baoli Wang,et al.  A Novel Intelligent Multi-attribute Three-Way Group Sorting Method Based on Dempster-Shafer Theory , 2014, RSKT.

[24]  Yiyu Yao,et al.  Decision-theoretic three-way approximations of fuzzy sets , 2014, Inf. Sci..

[25]  Qingguo Li,et al.  Characteristics of three-way concept lattices and three-way rough concept lattices , 2018, Knowl. Based Syst..

[26]  Bao Qing Hu,et al.  Three-way decisions space and three-way decisions , 2014, Inf. Sci..

[27]  Qinghua Zhang,et al.  A Sequential Three-Way Decision Model With Intuitionistic Fuzzy Numbers , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[28]  Caihui Liu,et al.  Multigranulation sequential three-way decisions based on multiple thresholds , 2019, Int. J. Approx. Reason..

[29]  Yiyu Yao,et al.  Tri-level thinking: models of three-way decision , 2020, Int. J. Mach. Learn. Cybern..

[30]  Jiye Liang,et al.  Incomplete Multigranulation Rough Set , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[31]  Bing Huang,et al.  Sequential three-way decision based on multi-granular autoencoder features , 2020, Inf. Sci..

[32]  Hamido Fujita,et al.  Updating three-way decisions in incomplete multi-scale information systems , 2019, Inf. Sci..

[33]  Guoyin Wang,et al.  A Novel Three-way decision model with decision-theoretic rough sets using utility theory , 2018, Knowl. Based Syst..

[34]  Andrey V. Savchenko,et al.  Sequential three-way decisions in multi-category image recognition with deep features based on distance factor , 2019, Inf. Sci..

[35]  Hong-Ying Zhang,et al.  Ranking interval sets based on inclusion measures and applications to three-way decisions , 2016, Knowl. Based Syst..

[36]  Yiyu Yao,et al.  Three-way decisions with probabilistic rough sets , 2010, Inf. Sci..

[37]  Fan Min,et al.  Frequent pattern discovery with tri-partition alphabets , 2020, Inf. Sci..

[38]  Jinkun Chen,et al.  Feature selection via neighborhood multi-granulation fusion , 2014, Knowl. Based Syst..

[39]  Angelo Gaeta,et al.  Improving awareness in early stages of security analysis: A zone partition method based on GrC , 2018, Applied Intelligence.

[40]  Sven Leyffer,et al.  Nonlinear programming without a penalty function , 2002, Math. Program..

[41]  Yiyu Yao,et al.  Three-Way Decision: An Interpretation of Rules in Rough Set Theory , 2009, RSKT.

[42]  Xin Yang,et al.  A sequential three-way approach to multi-class decision , 2019, Int. J. Approx. Reason..

[43]  Yiyu Yao,et al.  A Decision Theoretic Framework for Approximating Concepts , 1992, Int. J. Man Mach. Stud..

[44]  Jerzy W. Grzymala-Busse,et al.  Rough Sets , 1995, Commun. ACM.

[45]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[46]  Andrey V. Savchenko,et al.  Sequential Three-Way Decisions in Efficient Classification of Piecewise Stationary SpeechSignals , 2017, IJCRS.

[47]  Lina Bertling Tjernberg,et al.  An Artificial Neural Network Approach for Early Fault Detection of Gearbox Bearings , 2015, IEEE Transactions on Smart Grid.

[48]  Guoyin Wang,et al.  Three-way decision model with two types of classification errors , 2017, Inf. Sci..

[49]  Huaxiong Li,et al.  Risk Decision Making Based on Decision-theoretic Rough Set: A Three-way View Decision Model , 2011 .

[50]  Guoyin Wang,et al.  Fuzzy Entropy: A More Comprehensible Perspective for Interval Shadowed Sets of Fuzzy Sets , 2020, IEEE Transactions on Fuzzy Systems.

[51]  Hamido Fujita,et al.  On modeling similarity and three-way decision under incomplete information in rough set theory , 2020, Knowl. Based Syst..

[52]  Xiuyi Jia,et al.  Two-Phase Classification Based on Three-Way Decisions , 2013, RSKT.

[53]  Guoyin Wang,et al.  Knowledge reduction algorithms based on rough set and conditional information entropy , 2002, SPIE Defense + Commercial Sensing.

[54]  Liye Zhang,et al.  Three-way decision making approach to conflict analysis and resolution using probabilistic rough set over two universes , 2020, Inf. Sci..

[55]  Jiye Liang,et al.  International Journal of Approximate Reasoning Multigranulation Decision-theoretic Rough Sets , 2022 .

[56]  Fan Min,et al.  Cost-sensitive approximate attribute reduction with three-way decisions , 2019, Int. J. Approx. Reason..

[57]  Guoyin Wang,et al.  Granular computing: from granularity optimization to multi-granularity joint problem solving , 2016, Granular Computing.

[58]  Yuhua Qian,et al.  Concept learning via granular computing: A cognitive viewpoint , 2014, Information Sciences.

[59]  Qinghua Hu,et al.  Feature selection with test cost constraint , 2012, ArXiv.

[60]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[61]  Bingzhen Sun,et al.  On relationship between probabilistic rough set and Bayesian risk decision over two universes , 2012, Int. J. Gen. Syst..

[62]  Jun Wang,et al.  Stepwise optimal scale selection for multi-scale decision tables via attribute significance , 2017, Knowl. Based Syst..

[63]  Tianxing Wang,et al.  An optimization-based formulation for three-way decisions , 2019, Inf. Sci..

[64]  Lin Shang,et al.  Sentiment Analysis with Automatically Constructed Lexicon and Three-Way Decision , 2014, RSKT.

[65]  Bing Huang,et al.  Cost-sensitive sequential three-way decision modeling using a deep neural network , 2017, Int. J. Approx. Reason..

[66]  Bing Shi,et al.  Regression-based three-way recommendation , 2017, Inf. Sci..

[67]  Fan Min,et al.  Three-way recommender systems based on random forests , 2016, Knowl. Based Syst..