A novel approach to minimum attribute reduction based on quantum-inspired self-adaptive cooperative co-evolution

Attribute reduction in rough set theory is an important feature selection method. However it has been proven as an NP-hard problem to find minimum attribute reduction. It is therefore necessary to investigate efficient heuristic algorithms to find near-optimal solutions. In this paper, a novel and efficient minimum attribute reduction algorithm based on quantum-inspired self-adaptive cooperative co-evolution incorporated into shuffled frog leaping algorithm is proposed. First, evolutionary frog individuals are represented by multi-state quantum bits, and self-adaptive quantum rotation angle and quantum mutation probability strategy are adopted to update the operation of quantum revolving door. Second, a self-adaptive cooperative co-evolutionary model for minimum attribute reduction is designed to divide the evolutionary attribute sets into reasonable subsets. The subsets are assigned the self-adaptive mechanism according to their historical performance records, and each of them is evolved by the quantum-inspired shuffled frog leaping algorithm. So the reasonable decompositions are more easily produced by exploiting any correlation and interdependency between attribute subsets interaction. Finally, global convergence of the proposed algorithm is proved in theory, and its performance is investigated on some global optimization functions, UCI datasets and magnetic resonance images (MRIs), compared with existing state-of-the-art algorithms. The results demonstrate that the proposed algorithm can achieve a higher performance on the convergence rate and stability of attribute reduction. So it can be considered as a more competitive heuristic algorithm on the efficiency and accuracy of minimum attribute reduction.

[1]  Xiaodong Li,et al.  Cooperative Co-evolution with delta grouping for large scale non-separable function optimization , 2010, IEEE Congress on Evolutionary Computation.

[2]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[3]  Kevin E Lansey,et al.  Optimization of Water Distribution Network Design Using the Shuffled Frog Leaping Algorithm , 2003 .

[4]  Xin Yao,et al.  Large scale evolutionary optimization using cooperative coevolution , 2008, Inf. Sci..

[5]  Chen Fang,et al.  An effective shuffled frog-leaping algorithm for resource-constrained project scheduling problem , 2012, Comput. Oper. Res..

[6]  Hussein A. Abbass,et al.  Classification rule discovery with ant colony optimization , 2003, IEEE/WIC International Conference on Intelligent Agent Technology, 2003. IAT 2003..

[7]  César Hervás-Martínez,et al.  COVNET: a cooperative coevolutionary model for evolving artificial neural networks , 2003, IEEE Trans. Neural Networks.

[8]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[9]  Li Mo,et al.  Short-term hydrothermal generation scheduling using differential real-coded quantum-inspired evolutionary algorithm , 2012 .

[10]  Andries Petrus Engelbrecht,et al.  A Cooperative approach to particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[11]  Jinwei Gu,et al.  A novel competitive co-evolutionary quantum genetic algorithm for stochastic job shop scheduling problem , 2010, Comput. Oper. Res..

[12]  Jyh-Ching Juang,et al.  Quantum-inspired space search algorithm (QSSA) for global numerical optimization , 2011, Appl. Math. Comput..

[13]  Jie Zhou,et al.  Research of reduct features in the variable precision rough set model , 2009, Neurocomputing.

[14]  Leandro dos Santos Coelho,et al.  Particle swarm approach based on quantum mechanics and harmonic oscillator potential well for economic load dispatch with valve-point effects , 2008 .

[15]  Xiao-yan Zhang,et al.  A Multi-objective Optimization based on Hybrid Quantum Evolutionary Algorithm in Networked Control System , 2012 .

[16]  Wei-Chang Yeh,et al.  Feature selection with Intelligent Dynamic Swarm and Rough Set , 2010, Expert Syst. Appl..

[17]  Peter W. Shor,et al.  Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1995, SIAM Rev..

[18]  Yumin Chen,et al.  A rough set approach to feature selection based on power set tree , 2011, Knowl. Based Syst..

[19]  Ali Maroosi,et al.  Application of shuffled frog-leaping algorithm on clustering , 2009 .

[20]  Mourad Ykhlef,et al.  A Quantum Swarm Evolutionary Algorithm for mining association rules in large databases , 2011, J. King Saud Univ. Comput. Inf. Sci..

[21]  Leandro dos Santos Coelho,et al.  Improved quantum-inspired evolutionary algorithm with diversity information applied to economic dispatch problem with prohibited operating zones , 2011 .

[22]  Shouyang Wang,et al.  Bipolar fuzzy rough set model on two different universes and its application , 2012, Knowl. Based Syst..

[23]  Jyh-Ching Juang,et al.  A region-based quantum evolutionary algorithm (RQEA) for global numerical optimization , 2013, J. Comput. Appl. Math..

[24]  Inés María Galván,et al.  AMPSO: A New Particle Swarm Method for Nearest Neighborhood Classification , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[25]  Guoyin Wang,et al.  Rough reduction in algebra view and information view , 2003, Int. J. Intell. Syst..

[26]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithms with a new termination criterion, H/sub /spl epsi// gate, and two-phase scheme , 2004, IEEE Transactions on Evolutionary Computation.

[27]  Zhongzhi Shi,et al.  Extended rough set-based attribute reduction in inconsistent incomplete decision systems , 2012, Inf. Sci..

[28]  Yangyang Li,et al.  Quantum-Inspired Immune Clonal Algorithm for Global Optimization , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Yiyu Yao,et al.  Attribute reduction in decision-theoretic rough set models , 2008, Inf. Sci..

[30]  Gexiang Zhang,et al.  Quantum-inspired evolutionary algorithms: a survey and empirical study , 2011, J. Heuristics.

[31]  Lifeng Li,et al.  Attribute reduction in fuzzy concept lattices based on the T implication , 2010, Knowl. Based Syst..

[32]  X. Yao,et al.  Scaling up fast evolutionary programming with cooperative coevolution , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[33]  D. J. Newman,et al.  UCI Repository of Machine Learning Database , 1998 .

[34]  Xiaodong Li,et al.  Benchmark Functions for the CEC'2010 Special Session and Competition on Large-Scale , 2009 .

[35]  R. Paul Wiegand,et al.  Robustness in cooperative coevolution , 2006, GECCO '06.

[36]  Bingzhen Sun,et al.  Fuzzy rough set model on two different universes and its application , 2011 .

[37]  Ponnuthurai Nagaratnam Suganthan,et al.  Benchmark Functions for the CEC'2013 Special Session and Competition on Large-Scale Global Optimization , 2008 .

[38]  Qiang Shen,et al.  Finding Rough Set Reducts with Ant Colony Optimization , 2003 .

[39]  Qiang Shen,et al.  Fuzzy-rough data reduction with ant colony optimization , 2005, Fuzzy Sets Syst..

[40]  Dominik Slezak,et al.  Order Based Genetic Algorithms for the Search of Approximate Entropy Reducts , 2003, RSFDGrC.

[41]  Jeffrey K. Bassett,et al.  An Analysis of Cooperative Coevolutionary Algorithms A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2003 .

[42]  Guilong Liu,et al.  Rough set theory based on two universal sets and its applications , 2010, Knowl. Based Syst..

[43]  Dongyi Ye,et al.  A New Algorithm for Minimum Attribute Reduction Based on Binary Particle Swarm Optimization with Vaccination , 2007, PAKDD.

[44]  Witold Pedrycz,et al.  Positive approximation: An accelerator for attribute reduction in rough set theory , 2010, Artif. Intell..

[45]  Weixiang Liu,et al.  Combining Quantum-Behaved PSO and K2 Algorithm for Enhancing Gene Network Construction , 2013 .

[46]  Leandro dos Santos Coelho,et al.  A chaotic quantum-behaved particle swarm approach applied to optimization of heat exchangers , 2012 .

[47]  Q. Henry Wu,et al.  MCPSO: A multi-swarm cooperative particle swarm optimizer , 2007, Appl. Math. Comput..

[48]  Yitian Xu,et al.  A dynamic attribute reduction algorithm based on 0-1 integer programming , 2011, Knowl. Based Syst..

[49]  Lov K. Grover Quantum Mechanics Helps in Searching for a Needle in a Haystack , 1997, quant-ph/9706033.

[50]  Wei-Zhi Wu,et al.  Approaches to knowledge reductions in inconsistent systems , 2003, Int. J. Intell. Syst..

[51]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..

[52]  Degang Chen,et al.  Fuzzy rough set based attribute reduction for information systems with fuzzy decisions , 2011, Knowl. Based Syst..

[53]  Qiang Shen,et al.  Semantics-preserving dimensionality reduction: rough and fuzzy-rough-based approaches , 2004, IEEE Transactions on Knowledge and Data Engineering.

[54]  K. C. Tan,et al.  Continuous Optimization A competitive and cooperative coevolutionary approach to multi-objective particle swarm optimization algorithm design , 2009 .

[55]  Siu Cheung Hui,et al.  Associative Classification With Artificial Immune System , 2009, IEEE Transactions on Evolutionary Computation.

[56]  Andrzej Skowron,et al.  Rough set methods in feature selection and recognition , 2003, Pattern Recognit. Lett..

[57]  Hai-Long Yang A note on "Rough set theory based on two universal sets and its applications" Knowledge-Based Systems 23 (2010) 110-115 , 2011, Knowl. Based Syst..

[58]  Xiangyang Wang,et al.  Feature selection based on rough sets and particle swarm optimization , 2007, Pattern Recognit. Lett..

[59]  Zuren Feng,et al.  An efficient ant colony optimization approach to attribute reduction in rough set theory , 2008, Pattern Recognit. Lett..

[60]  Peter W. Shor Polynomial-Time Algorithms for Prime Factorization and Discrete Logarithms on a Quantum Computer , 1999 .

[61]  Jong-Hwan Kim,et al.  Quantum-Inspired Evolutionary Algorithms With a New Termination Criterion , H Gate , and Two-Phase Scheme , 2009 .

[62]  Sushmita Mitra,et al.  Feature Selection Using Rough Sets , 2006, Multi-Objective Machine Learning.

[63]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.