Attribute group for attribute reduction

Abstract In the field of rough set, how to improve the efficiency of obtaining reduct has been paid much attention to. One of the typical strategies is to reduce the number of comparisons among samples, it follows that the time consumption of generating binary relation can be saved for quickly obtaining reduct. Nevertheless, such mechanism is only designed by reducing the number of times to scan samples, which fails in reducing the iterations of evaluating attributes. To fill such gap, an acceleration strategy based on attribute group is proposed. Firstly, all of the candidate attributes are divided into different groups. Secondly, in the process of searching reduct, only the attributes out of those groups which contain at least one attribute in the potential reduct should be evaluated. It should be noticed that this is the key which can reduce the number of evaluations of candidate attributes. Finally, the above two steps are repeated until the constraint defined in attribute reduction is satisfied. To demonstrate the effectiveness of our proposed method, the experiments have been conducted over three neighborhood rough set models by leveraging four measures. Compared with the existing forward greedy searching approach over 12 UCI data sets, the experimental results show that our attribute group based approach can maintain the classification performance derived by reducts while significantly accelerating the searching process of obtaining reduct. This study suggests a new trend concerning the problem of quickly computing reduct.

[1]  Yiyu Yao,et al.  On Reduct Construction Algorithms , 2006, Trans. Comput. Sci..

[2]  Yuhua Qian,et al.  Accelerator for multi-granularity attribute reduction , 2019, Knowl. Based Syst..

[3]  Xin Yang,et al.  A sequential three-way approach to multi-class decision , 2019, Int. J. Approx. Reason..

[4]  Yiyu Yao,et al.  Ensemble selector for attribute reduction , 2018, Appl. Soft Comput..

[5]  Qinghua Hu,et al.  Feature and instance reduction for PNN classifiers based on fuzzy rough sets , 2014, International Journal of Machine Learning and Cybernetics.

[6]  Jing-Yu Yang,et al.  Multi-label learning with label-specific feature reduction , 2016, Knowl. Based Syst..

[7]  Qinghua Hu,et al.  Neighborhood classifiers , 2008, Expert Syst. Appl..

[8]  Yuhua Qian,et al.  A comparative study of multigranulation rough sets and concept lattices via rule acquisition , 2016, Knowl. Based Syst..

[9]  Jianhua Dai,et al.  Conditional entropy for incomplete decision systems and its application in data mining , 2012, Int. J. Gen. Syst..

[10]  Witold Pedrycz,et al.  Building the fundamentals of granular computing: A principle of justifiable granularity , 2013, Appl. Soft Comput..

[11]  Degang Chen,et al.  Attribute Reduction for Heterogeneous Data Based on the Combination of Classical and Fuzzy Rough Set Models , 2014, IEEE Transactions on Fuzzy Systems.

[12]  Qinghua Hu,et al.  Neighborhood rough set based heterogeneous feature subset selection , 2008, Inf. Sci..

[13]  Jiye Liang,et al.  Compacted decision tables based attribute reduction , 2015, Knowl. Based Syst..

[14]  Yuhua Qian,et al.  Multi-granularity feature selection on cost-sensitive data with measurement errors and variable costs , 2018, Knowl. Based Syst..

[15]  Xibei Yang,et al.  Dynamic updating multigranulation fuzzy rough set: approximations and reducts , 2014, International Journal of Machine Learning and Cybernetics.

[16]  Yong Qi,et al.  Updating multigranulation rough approximations with increasing of granular structures , 2014, Knowl. Based Syst..

[17]  Witold Pedrycz,et al.  From fuzzy data analysis and fuzzy regression to granular fuzzy data analysis , 2015, Fuzzy Sets Syst..

[18]  Witold Pedrycz,et al.  Selecting Discrete and Continuous Features Based on Neighborhood Decision Error Minimization , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[19]  Yibo Wang,et al.  Attribute reduction via local conditional entropy , 2019, International Journal of Machine Learning and Cybernetics.

[20]  Wenjian Wang,et al.  Markov cross-validation for time series model evaluations , 2017, Inf. Sci..

[21]  Ming-Wen Shao,et al.  Attribute reduction based on k-nearest neighborhood rough sets , 2019, Int. J. Approx. Reason..

[22]  Shang Gao,et al.  Pseudo-label neighborhood rough set: Measures and attribute reductions , 2019, Int. J. Approx. Reason..

[23]  Qinghua Hu,et al.  Multi-granularity distance metric learning via neighborhood granule margin maximization , 2014, Inf. Sci..

[24]  Yuhua Qian,et al.  Test-cost-sensitive attribute reduction , 2011, Inf. Sci..

[25]  Hualong Yu,et al.  Rough set based semi-supervised feature selection via ensemble selector , 2019, Knowl. Based Syst..

[26]  Jinhai Li,et al.  Neighborhood attribute reduction: a multi-criterion approach , 2019, Int. J. Mach. Learn. Cybern..

[27]  Qinghua Hu,et al.  Feature Selection Based on Neighborhood Discrimination Index , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[29]  Xin Yang,et al.  A temporal-spatial composite sequential approach of three-way granular computing , 2019, Inf. Sci..

[30]  Witold Pedrycz,et al.  Label distribution learning: A local collaborative mechanism , 2020, Int. J. Approx. Reason..

[31]  Xiao Zhang,et al.  Feature selection in mixed data: A method using a novel fuzzy rough set-based information entropy , 2016, Pattern Recognit..

[32]  Degang Chen,et al.  Minimal decision cost reduct in fuzzy decision-theoretic rough set model , 2017, Knowl. Based Syst..

[33]  Z. Pawlak Rough Sets: Theoretical Aspects of Reasoning about Data , 1991 .

[34]  Jiye Liang,et al.  Ieee Transactions on Knowledge and Data Engineering 1 a Group Incremental Approach to Feature Selection Applying Rough Set Technique , 2022 .

[35]  Witold Pedrycz,et al.  An efficient accelerator for attribute reduction from incomplete data in rough set framework , 2011, Pattern Recognit..

[36]  Jing-Yu Yang,et al.  Hierarchies on fuzzy information granulations: A knowledge distance based lattice approach , 2014, J. Intell. Fuzzy Syst..

[37]  Yong Qi,et al.  α-Dominance relation and rough sets in interval-valued information systems , 2015, Inf. Sci..

[38]  David A. Landgrebe,et al.  Feature Extraction Based on Decision Boundaries , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Wei Wei,et al.  Consistency-preserving attribute reduction in fuzzy rough set framework , 2013, Int. J. Mach. Learn. Cybern..

[40]  Angelo Gaeta,et al.  Resilience Analysis of Critical Infrastructures: A Cognitive Approach Based on Granular Computing , 2019, IEEE Transactions on Cybernetics.

[41]  Mingjie Cai,et al.  Related families-based attribute reduction of dynamic covering decision information systems , 2018, Knowl. Based Syst..

[42]  Yuhua Qian,et al.  Accelerator for supervised neighborhood based attribute reduction , 2020, Int. J. Approx. Reason..

[43]  Hamido Fujita,et al.  An efficient selector for multi-granularity attribute reduction , 2019, Inf. Sci..

[44]  Wei Wei,et al.  Information fusion in rough set theory : An overview , 2019, Inf. Fusion.

[45]  Jing-Yu Yang,et al.  Multigranulation rough set: A multiset based strategy , 2017, Int. J. Comput. Intell. Syst..

[46]  Degang Chen,et al.  An incremental algorithm for attribute reduction with variable precision rough sets , 2016, Appl. Soft Comput..

[47]  Jiang Yunliang,et al.  Quick attribute reduct algorithm for neighborhood rough set model , 2014 .