Sequential three-way decision based on multi-granular autoencoder features

Abstract Autoencoder network is an efficient representation learning method. In general, a finer feature set obtained from autoencoder leads to a lower error rate and lower total misclassification cost. However, the network is usually trained for a long time to obtain a finer feature set, leading to a high time cost and total cost. To address this issue, a Sequential Three-Way Decision (S3WD) model is developed to balance the misclassification cost and the time cost in autoencoder based classifications and decisions. To implement the tradeoff strategy, it is necessary to extract a multi-granular feature set. In the network, the associated discriminative information in the extracted features increases with training epochs, which constructs a multi-granular feature structure. An autoencoder-based multi-granular feature description definition is presented. Based on the definition, an autoencoder composed of restricted Boltzmann machines is adopted to extract the multi-granular features. Then, a new cost-sensitive S3WD model is proposed, which aims to find the optimal granule level with the lowest total cost. Finally, the experiments demonstrate the effectiveness of the proposed approaches.

[1]  Bing Huang,et al.  Sequential three-way decision and granulation for cost-sensitive face recognition , 2016, Knowl. Based Syst..

[2]  Jinhai Li,et al.  A local approach to rule induction in multi-scale decision tables , 2015, Knowl. Based Syst..

[3]  Jiye Liang,et al.  Pessimistic rough set based decisions: A multigranulation fusion strategy , 2014, Inf. Sci..

[4]  Witold Pedrycz,et al.  Granular Data Aggregation: An Adaptive Principle of the Justifiable Granularity Approach , 2019, IEEE Transactions on Cybernetics.

[5]  Jinhai Li,et al.  Granule description based knowledge discovery from incomplete formal contexts via necessary attribute analysis , 2019, Inf. Sci..

[6]  Yiyu Yao,et al.  A unified model of sequential three-way decisions and multilevel incremental processing , 2017, Knowl. Based Syst..

[7]  Tao Feng,et al.  Uncertainty and reduction of variable precision multigranulation fuzzy rough sets based on three-way decisions , 2017, Int. J. Approx. Reason..

[8]  Weihua Xu,et al.  Multiple granulation rough set approach to ordered information systems , 2012, Int. J. Gen. Syst..

[9]  Qinghua Hu,et al.  Attribute Selection for Partially Labeled Categorical Data By Rough Set Approach , 2017, IEEE Transactions on Cybernetics.

[10]  Wei-Zhi Wu,et al.  On rule acquisition in incomplete multi-scale decision tables , 2017, Inf. Sci..

[11]  Wei-Zhi Wu,et al.  Inclusion measure-based multi-granulation decision-theoretic rough sets in multi-scale intuitionistic fuzzy information tables , 2020, Inf. Sci..

[12]  Hironobu Fujiyoshi,et al.  To Be Bernoulli or to Be Gaussian, for a Restricted Boltzmann Machine , 2014, 2014 22nd International Conference on Pattern Recognition.

[13]  Feng Li,et al.  A new approach of optimal scale selection to multi-scale decision tables , 2017, Inf. Sci..

[14]  Jiye Liang,et al.  International Journal of Approximate Reasoning Multigranulation Decision-theoretic Rough Sets , 2022 .

[15]  Bing Huang,et al.  Cost-sensitive rough set: A multi-granulation approach , 2017, Knowl. Based Syst..

[16]  Yiyu Yao,et al.  Granular Computing and Sequential Three-Way Decisions , 2013, RSKT.

[17]  Nan Zhang,et al.  Attribute reduction for sequential three-way decisions under dynamic granulation , 2017, Int. J. Approx. Reason..

[18]  Zhi-Hua Zhou,et al.  Cost-Sensitive Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Jing-Yu Yang,et al.  Multigranulation rough set: A multiset based strategy , 2017, Int. J. Comput. Intell. Syst..

[20]  A. V. Savchenko,et al.  Fast multi-class recognition of piecewise regular objects based on sequential three-way decisions and granular computing , 2016, Knowl. Based Syst..

[21]  Duoqian Miao,et al.  Three-layer granular structures and three-way informational measures of a decision table , 2017, Inf. Sci..

[22]  Jingtao Yao,et al.  Gini objective functions for three-way classifications , 2017, Int. J. Approx. Reason..

[23]  Guoyin Wang,et al.  A tree-based incremental overlapping clustering method using the three-way decision theory , 2016, Knowl. Based Syst..

[24]  Lu Wang,et al.  Multi-objective attribute reduction in three-way decision-theoretic rough set model , 2019, Int. J. Approx. Reason..

[25]  Yiyu Yao,et al.  Detecting and refining overlapping regions in complex networks with three-way decisions , 2016, Inf. Sci..

[26]  Chen Hao,et al.  Optimal scale selection in dynamic multi-scale decision tables based on sequential three-way decisions , 2017, Inf. Sci..

[27]  Yiyu Yao,et al.  Dynamic probabilistic rough sets with incomplete data , 2017, Inf. Sci..

[28]  Bing Huang,et al.  Cost-sensitive sequential three-way decision modeling using a deep neural network , 2017, Int. J. Approx. Reason..

[29]  Bing Shi,et al.  Regression-based three-way recommendation , 2017, Inf. Sci..

[30]  Decui Liang,et al.  Incremental Learning Researches on Rough Set Theory: Status and Future , 2014, Int. J. Rough Sets Data Anal..

[31]  Qinghua Hu,et al.  Granular Computing Based Machine Learning in the Era of Big Data , 2017, Inf. Sci..

[32]  Zeshui Xu,et al.  Method for three-way decisions using ideal TOPSIS solutions at Pythagorean fuzzy information , 2018, Inf. Sci..

[33]  Guoyin Wang,et al.  A Dynamic Three-way Decision Model based on the Updating of Attribute Values , 2017, Knowl. Based Syst..

[34]  Federico Cabitza,et al.  Exploiting collective knowledge with three-way decision theory: Cases from the questionnaire-based research , 2017, Int. J. Approx. Reason..

[35]  Witold Pedrycz,et al.  Sequential three-way classifier with justifiable granularity , 2019, Knowl. Based Syst..

[36]  Yiyu Yao,et al.  Three-way decision and granular computing , 2018, Int. J. Approx. Reason..

[37]  Yuhua Qian,et al.  Three-way cognitive concept learning via multi-granularity , 2017, Inf. Sci..

[38]  Qinghua Hu,et al.  Transfer learning for short-term wind speed prediction with deep neural networks , 2016 .

[39]  Nicolas Le Roux,et al.  Representational Power of Restricted Boltzmann Machines and Deep Belief Networks , 2008, Neural Computation.

[40]  Dun Liu,et al.  Incremental approaches for updating approximations in set-valued ordered information systems , 2013, Knowl. Based Syst..

[41]  Yiyu Yao,et al.  Actionable strategies in three-way decisions , 2017, Knowl. Based Syst..

[42]  Fan Min,et al.  Tri-partition cost-sensitive active learning through kNN , 2017, Soft Computing.

[43]  Yiyu Yao,et al.  Constructing shadowed sets and three-way approximations of fuzzy sets , 2017, Inf. Sci..

[44]  Jianming Zhan,et al.  Covering based multigranulation (I, T)-fuzzy rough set models and applications in multi-attribute group decision-making , 2019, Inf. Sci..

[45]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Yiyu Yao,et al.  Rough set models in multigranulation spaces , 2016, Inf. Sci..

[47]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[48]  Yiyu Yao,et al.  Sequential three-way decisions with probabilistic rough sets , 2011, IEEE 10th International Conference on Cognitive Informatics and Cognitive Computing (ICCI-CC'11).

[49]  Fan Min,et al.  Frequent pattern discovery with tri-partition alphabets , 2020, Inf. Sci..

[50]  Caihui Liu,et al.  On multi-granulation covering rough sets , 2014, Int. J. Approx. Reason..