Enhanced cultural algorithm to solve multi-objective attribute reduction based on rough set theory

Abstract In extracting hidden information from a data, its high dimension can create challenges in the quality of the extracted information and the search space size. Attribute reduction based on minimizing both missed information and selected subset attributes is logical solution for the challenge. Rough set theory (RST) is an information recognition technique in uncertain data that it shows the value missed information for the selected attributes. In this paper, a multi-objective attribute reduction (MOAR) is modeled by designing a new effective cost function to optimize the minimum number of attributes with the maximum dependency coefficient of the RST. Due to the MOAR is an NP-hard problem, an enhanced draft of cultural algorithm, as a continuous optimization algorithm, is proposed to solve it, as a discrete problem for the first time. The cultural algorithm (CA) with a dual inheritance system is enhanced by utilizing just normative and situational components to generate new individuals and planning a novel heuristic to discrete population and belief spaces. With regard to design the research problem, the CA and five algorithms are implemented to compare their results on twelve well-known UCI datasets in three categories sizes; small, middle and large. The tuning algorithm’s parameters to find the best possible values are done and different size of the population is considered to evaluate the sensitivity of the algorithms on the population size parameter. The experimental results show that the proposed algorithm is able to find competitive results when compared to the state-of-the-art algorithms.

[1]  Mengjie Zhang,et al.  Binary PSO and Rough Set Theory for Feature Selection: a Multi-objective filter Based Approach , 2014, Int. J. Comput. Intell. Appl..

[2]  Kaushal Kumar Shukla,et al.  Tolerance-based intuitionistic fuzzy-rough set approach for attribute reduction , 2018, Expert Syst. Appl..

[3]  William Zhu,et al.  A Genetic Algorithm to Multi-objective Cost-sensitive Attribute Reduction , 2014 .

[4]  محمد قانعی استاد,et al.  کاهش ویژگی سیستمهای اطلاعاتی ناقص بر مبنای تئوری مجموعۀ راف با استفاده از الگوریتم رقابت استعماری فازی , 2017 .

[5]  Julie Josse,et al.  Bayesian Dimensionality Reduction With PCA Using Penalized Semi-Integrated Likelihood , 2016, 1606.05333.

[6]  Yumin Chen,et al.  Finding rough set reducts with fish swarm algorithm , 2015, Knowl. Based Syst..

[7]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[8]  Hichem Hassine,et al.  Efficient Cultural Algorithm for Structural Damage Detection Problem Based on Modal Data , 2018, Applied Condition Monitoring.

[9]  Duoqian Miao,et al.  A rough set approach to feature selection based on ant colony optimization , 2010, Pattern Recognit. Lett..

[10]  Robert G. Reynolds,et al.  CADE: A hybridization of Cultural Algorithm and Differential Evolution for numerical optimization , 2017, Inf. Sci..

[11]  Wei Wang,et al.  An optimal vibration control strategy for a vehicle's active suspension based on improved cultural algorithm , 2015, Appl. Soft Comput..

[12]  Jianpei Zhang,et al.  Research on cultural algorithm for solving routing problem of mobile agent , 2008 .

[13]  Dongyi Ye,et al.  A new approach to minimum attribute reduction based on discrete artificial bee colony , 2015, Soft Comput..

[14]  K. Thanushkodi,et al.  A Novel Rough Set Reduct Algorithm for Medical Domain Based on Bee Colony Optimization , 2010, ArXiv.

[15]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[16]  Carlos A. Coello Coello,et al.  Solving timetabling problems using a cultural algorithm , 2011, Appl. Soft Comput..

[17]  Sujatha Srinivasan,et al.  Cultural Algorithm Toolkit for Multi-objective Rule Mining , 2012, ArXiv.

[18]  Pooya Moradian Zadeh,et al.  A Multi-Population Cultural Algorithm for Community Detection in Social Networks , 2015, ANT/SEIT.

[19]  Tingzhang Liu,et al.  A novel attribute reduction algorithm based on rough set and improved artificial fish swarm algorithm , 2016, Neurocomputing.

[20]  Ke Lu,et al.  Multi-objective optimization method for learning thresholds in a decision-theoretic rough set model , 2016, Int. J. Approx. Reason..

[21]  Masao Fukushima,et al.  Tabu search for attribute reduction in rough set theory , 2008, Soft Comput..

[22]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[23]  Fan Min,et al.  A PSO algorithm for multi-objective cost-sensitive attribute reduction on numeric data with error ranges , 2017, Soft Comput..

[24]  Fan Min,et al.  Multi-objective cost-sensitive attribute reduction on data with error ranges , 2016, Int. J. Mach. Learn. Cybern..

[25]  Dongyi Ye,et al.  A novel and better fitness evaluation for rough set based minimum attribute reduction problem , 2013, Inf. Sci..

[26]  Majid Abdolrazzagh-Nezhad,et al.  A Modified Electromagnetic-Like Mechanism for Rough Set Attribute Reduction , 2016, ICIST.

[27]  Weitong Chen,et al.  Multi-task support vector machines for feature selection with shared knowledge discovery , 2016, Signal Process..

[28]  Nima Jafari Navimipour,et al.  An Energy-Aware Task Scheduling in the Cloud Computing Using a Hybrid Cultural and Ant Colony Optimization Algorithm , 2017, Int. J. Cloud Appl. Comput..

[29]  Kalyanmoy Deb,et al.  Multi-objective Optimization , 2014 .

[30]  K. Thangavel,et al.  Dimensionality reduction based on rough set theory: A review , 2009, Appl. Soft Comput..

[31]  Hans-Peter Kriegel,et al.  Clustering high-dimensional data: A survey on subspace clustering, pattern-based clustering, and correlation clustering , 2009, TKDD.

[32]  Robert G. Reynolds The Cultural Algorithm: Culture on the Edge of Chaos , 2018 .

[33]  Lakhmi C. Jain,et al.  Feature Selection for Data and Pattern Recognition , 2014, Feature Selection for Data and Pattern Recognition.

[34]  Lu Wang,et al.  Multi-objective attribute reduction in three-way decision-theoretic rough set model , 2019, Int. J. Approx. Reason..

[35]  Ming-Wen Shao,et al.  Fuzzy rough set-based attribute reduction using distance measures , 2019, Knowl. Based Syst..

[36]  Yu Zhang Research of Web Search Based on Cultural Algorithm New Framework , 2012 .

[37]  Jingtao Yao,et al.  Game-Theoretic Rough Sets , 2011, Fundam. Informaticae.

[38]  Robert G. Reynolds,et al.  Cultural algorithms: modeling of how cultures learn to solve problems , 2004, 16th IEEE International Conference on Tools with Artificial Intelligence.

[39]  Abdelaziz Bouroumi,et al.  A multipopulation cultural algorithm using fuzzy clustering , 2007, Appl. Soft Comput..

[40]  Abbas Keramati,et al.  Cultural algorithm for feature selection , 2011, The 3rd International Conference on Data Mining and Intelligent Information Technology Applications.

[41]  Ching-Hsue Cheng,et al.  A hybrid model based on rough sets theory and genetic algorithms for stock price forecasting , 2010, Inf. Sci..

[42]  Yiyu Yao,et al.  Generalized attribute reduct in rough set theory , 2016, Knowl. Based Syst..

[43]  Si-Yuan Jing,et al.  A hybrid genetic algorithm for feature subset selection in rough set theory , 2014, Soft Comput..

[44]  Robert G. Reynolds,et al.  CULTURAL ALGORITHMS: COMPUTATIONAL MODELING OF HOW CULTURES LEARN TO SOLVE PROBLEMS: AN ENGINEERING EXAMPLE , 2005, Cybern. Syst..

[45]  Zdzisław Pawlak,et al.  Rough set theory and its applications , 2002, Journal of Telecommunications and Information Technology.

[46]  Weiping Ding,et al.  A novel approach to minimum attribute reduction based on quantum-inspired self-adaptive cooperative co-evolution , 2013, Knowl. Based Syst..

[47]  Xuesong Yan,et al.  An improved cultural algorithm and its application in image matching , 2017, Multimedia Tools and Applications.

[48]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[49]  Yuwen Li,et al.  Attribute reduction for multi-label learning with fuzzy rough set , 2018, Knowl. Based Syst..

[50]  Siddhartha Bhattacharyya,et al.  A group incremental feature selection for classification using rough set theory based genetic algorithm , 2018, Appl. Soft Comput..

[51]  Jiaxu Wang,et al.  Weak fault diagnosis of rotating machinery based on feature reduction with Supervised Orthogonal Local Fisher Discriminant Analysis , 2015, Neurocomputing.

[52]  Zongben Xu,et al.  A multiobjective ACO algorithm for rough feature selection , 2010, 2010 Second Pacific-Asia Conference on Circuits, Communications and System.

[53]  Jon Atli Benediktsson,et al.  Spectral and Spatial Classification of Hyperspectral Images Based on ICA and Reduced Morphological Attribute Profiles , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[54]  Yong Wang,et al.  Feature extraction using a fast null space based linear discriminant analysis algorithm , 2012, Inf. Sci..