Negatively Correlated Search as a Parallel Exploration Search Strategy

Parallel exploration is a key to a successful search. The recently proposed Negatively Correlated Search (NCS) achieved this ability by constructing a set of negatively correlated search processes and has been applied to many real-world problems. In NCS, the key technique is to explicitly model and maximize the diversity among search processes in parallel. However, the original diversity model was mostly devised by intuition, which introduced several drawbacks to NCS. In this paper, a mathematically principled diversity model is proposed to solve the existing drawbacks of NCS, resulting a new NCS framework. A new instantiation of NCS is also derived and its effectiveness is verified on a set of multi-modal continuous optimization problems.

[1]  Shangce Gao,et al.  Negative Correlation Learning Enhanced Search Behavior in Backtracking Search Optimization , 2018, 2018 10th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC).

[2]  Tom Schaul,et al.  Natural Evolution Strategies , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[3]  Qun Niu,et al.  A Novel Binary Negatively Correlated Search for Wind Farm Layout Optimization , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[4]  José Antonio Lozano,et al.  Path Planning for Single Unmanned Aerial Vehicle by Separately Evolving Waypoints , 2015, IEEE Transactions on Robotics.

[5]  Youmin Zhang,et al.  Time Series Forecasting by Evolving Deep Belief Network with Negative Correlation Search , 2018, 2018 Chinese Automation Congress (CAC).

[6]  Ke Tang,et al.  Improving Estimation of Distribution Algorithm on Multimodal Problems by Detecting Promising Areas , 2015, IEEE Transactions on Cybernetics.

[7]  Liqun Fu,et al.  Optimal Energy-Delay Scheduling for Energy Harvesting WSNs via Negatively Correlated Search , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[8]  Chao Qian,et al.  Optimization based Layer-wise Magnitude-based Pruning for DNN Compression , 2018, IJCAI.

[9]  Ke Tang,et al.  Optimal Stochastic and Online Learning with Individual Iterates , 2019, NeurIPS.

[10]  T. Kailath.  The Divergence and Bhattacharyya Distance Measures in Signal Selection , 1967 .

[11]  Jing J. Liang,et al.  Problem Definitions and Evaluation Criteria for the CEC 2005 Special Session on Real-Parameter Optimization , 2005 .

[12]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[13]  Xin Yao,et al.  Negatively Correlated Search , 2015, IEEE Journal on Selected Areas in Communications.

[14]  Pascal Bouvry,et al.  EVOLVE - A Bridge between Probability, Set Oriented Numerics and Evolutionary Computation IV [EVOLVE 2013, Leiden The Netherlands, July 10-13, 2013] , 2013 .

[15]  Xin Yao,et al.  Turning High-Dimensional Optimization Into Computationally Expensive Optimization , 2018, IEEE Transactions on Evolutionary Computation.

[16]  Xin Yao,et al.  From an individual to a population: an analysis of the first hitting time of population-based evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[17]  Keith Dickerson.  EVOLVE - A Bridge between Probability, Set Oriented Numerics and Evolutionary Computation , 2013, EVOLVE.

[18]  Xin Yao,et al.  Evolutionary programming made faster , 1999, IEEE Trans. Evol. Comput..

[19]  Yuki Todo,et al.  An Efficient Negative Correlation Gravitational Search Algorithm , 2018, 2018 IEEE International Conference on Progress in Informatics and Computing (PIC).

[20]  Xiao Yang,et al.  An Improved Firefly Algorithm Enhanced by Negatively Correlated Search Mechanism , 2018, 2018 IEEE International Conference on Progress in Informatics and Computing (PIC).

[21]  Xin Yao,et al.  Ensemble learning via negative correlation , 1999, Neural Networks.

[22]  Liu Bing,et al.  An Improved Negatively Correlated Search Inspired by Particle Swarm Optimization , 2019 .

[23]  Douglas A. Reynolds.  Gaussian Mixture Models , 2009, Encyclopedia of Biometrics.