An adaptive configuration of differential evolution algorithms for big data

Recent years have witnessed the success of evolutionary algorithms, such as differential evolution, in solving many complex optimization problems. However, evolutionary algorithms face difficulties when solving high dimensional problems in conjunction with a huge amount of data. Due to the fact that no single differential evolution algorithm is the best for all types of test problems, in this paper, an adaptive configuration of differential evolution algorithms is proposed for solving the 2015 big data optimization competition problems. In it, different differential evolution variants are used. The proposed algorithm automatically determines the best variant, which is subsequently used to evolve a population of individuals till the end of evolutionary process. Additionally, a local search is applied to increase the exploitation capability of the proposed algorithm. The results of solving six single objective problems, and six multi-objective problems, show the superiority of the proposed algorithm to the baseline algorithm's results provided by the competition organizers.

[1]  Samuel Madden,et al.  From Databases to Big Data , 2012, IEEE Internet Comput..

[2]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[3]  Abdullah Al Mamun,et al.  Decompositional independent component analysis using multi-objective optimization , 2016, Soft Comput..

[4]  Gonzalo Mateos,et al.  Modeling and Optimization for Big Data Analytics: (Statistical) learning tools for our era of data deluge , 2014, IEEE Signal Processing Magazine.

[5]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[6]  Ruhul A. Sarker,et al.  3 Decomposition-based evolutionary algorithm for large scale , 2014 .

[7]  Ruhul A. Sarker,et al.  United multi-operator evolutionary algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[8]  J. Alberto Espinosa,et al.  Big Data: Issues and Challenges Moving Forward , 2013, 2013 46th Hawaii International Conference on System Sciences.

[9]  Md. Rafiqul Islam,et al.  Evolutionary optimization: A big data perspective , 2016, J. Netw. Comput. Appl..

[10]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[11]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[12]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[13]  Peter Richtárik,et al.  Parallel coordinate descent methods for big data optimization , 2012, Mathematical Programming.

[14]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[15]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[16]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[17]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[18]  Shengxiang Yang,et al.  Evolutionary dynamic optimization: A survey of the state of the art , 2012, Swarm Evol. Comput..

[19]  Seref Sagiroglu,et al.  Big data: A review , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).