Partial opposition-based learning using current best candidate solution

Opposition based learning (OBL) has been gaining significant attention in machine learning, specially, in metaheuristic optimization algorithms to take OBL's advantage for enhancing their performance. In OBL, all variables are changed to their opposites while some variables are currently holding proper values which are discarded and converted to worse values by performing opposite. The partial opposition scheme was developed to change randomly some variables to its opposites but they do not pay enough attention to identify and keep variables which have proper values. In this paper, we propose a novel partial opposition scheme, which is generated based on the current best candidate solution. It tries to generate new trial solutions by using the candidate solutions and their opposites such that some variables of a candidate solution are remain unchanged and other variables are changed to their opposites in the trial solution (i.e., gene/variable based optimization). Variables in the trial solution are identified as close or far, according to their Euclidean distance from the corresponding variables/genes in the current best candidate solution. The proposed scheme uses the opposite of variables, which are closer to the current best solution. Only the new trial solutions are included in the next generation which are closer to corresponding opposite solution. As a case study, we employ the proposed partial opposition scheme in the DE algorithm and the partial opposition-based DE is evaluated on CEC-2014 benchmark functions. Simulation results confirm that the partial opposition-based DE obtains a promising performance on the majority of the benchmark functions. The proposed algorithm is compared with the Opposition-based DE (ODE) and random partial opposition-based DE algorithm (DE-RPO); the results show that our new method is better than or at least comparable to other competitors.

[1]  Hamid R. Tizhoosh,et al.  Reinforcement Learning Based on Actions and Opposite Actions , 2005 .

[2]  Mohammad Bagher Ahmadi,et al.  Opposition versus randomness in binary spaces , 2015, Appl. Soft Comput..

[3]  Mario Ventresca,et al.  Oppositional Concepts in Computational Intelligence , 2008, Oppositional Concepts in Computational Intelligence.

[4]  Shahryar Rahnamayan,et al.  Quasi-oppositional Differential Evolution , 2007, 2007 IEEE Congress on Evolutionary Computation.

[5]  Hamid R. Tizhoosh Opposite Fuzzy Sets with Applications in Image Processing , 2009, IFSA/EUSFLAT Conf..

[6]  Dan Simon,et al.  Probabilistic properties of fitness-based quasi-reflection in evolutionary algorithms , 2015, Comput. Oper. Res..

[7]  Mario Ventresca,et al.  Improving the Convergence of Backpropagation by Opposite Transfer Functions , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[8]  Shahryar Rahnamayan,et al.  A novel population initialization method for accelerating evolutionary algorithms , 2007, Comput. Math. Appl..

[9]  M.M.A. Salama,et al.  Opposition-Based Differential Evolution , 2008, IEEE Transactions on Evolutionary Computation.

[10]  Hamid R. Tizhoosh,et al.  Opposition-Based Learning: A New Scheme for Machine Intelligence , 2005, International Conference on Computational Intelligence for Modelling, Control and Automation and International Conference on Intelligent Agents, Web Technologies and Internet Commerce (CIMCA-IAWTIC'06).

[11]  Shahryar Rahnamayan,et al.  Type-II opposition-based differential evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[12]  Shahryar Rahnamayan,et al.  An intuitive distance-based explanation of opposition-based sampling , 2012, Appl. Soft Comput..

[13]  Zhongyi Hu,et al.  Partial opposition-based adaptive differential evolution algorithms: Evaluation on the CEC 2014 benchmark set for real-parameter optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[14]  Shahryar Rahnamayan,et al.  Computing opposition by involving entire population , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[15]  Zhijian Wu,et al.  Enhanced opposition-based differential evolution for solving high-dimensional continuous optimization problems , 2011, Soft Comput..

[16]  Shahryar Rahnamayan,et al.  Opposition-Based Differential Evolution Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[17]  Zhijian Wu,et al.  Rotation-Based Learning: A Novel Extension of Opposition-Based Learning , 2014, PRICAI.

[18]  Ponnuthurai Nagaratnam Suganthan,et al.  Problem Definitions and Evaluation Criteria for the CEC 2014 Special Session and Competition on Single Objective Real-Parameter Numerical Optimization , 2014 .

[19]  Ju-Jang Lee,et al.  Stochastic Opposition-Based Learning Using a Beta Distribution in Differential Evolution , 2016, IEEE Transactions on Cybernetics.

[20]  Valeria V. Krzhizhanovskaya,et al.  How to Speed up Optimization? Opposite-center Learning and Its Application to Differential Evolution , 2015, ICCS.