Differential evolution framework for big data optimization

During the last two decades, dealing with big data problems has become a major issue for many industries. Although, in recent years, differential evolution has been successful in solving many complex optimization problems, there has been research gaps on using it to solve big data problems. As a real-time big data problem may not be known in advance, determining the appropriate differential evolution operators and parameters to use is a combinatorial optimization problem. Therefore, in this paper, a general differential evolution framework is proposed, in which the most suitable differential evolution algorithm for a problem on hand is adaptively configured. A local search is also employed to increase the exploitation capability of the proposed algorithm. The algorithm is tested on the 2015 big data optimization competition problems (six single objective problems and six multi-objective problems). The results show the superiority of the proposed algorithm to several state-of-the-art algorithms.

[1]  Xiaodong Li,et al.  Cooperative Co-Evolution With Differential Grouping for Large Scale Optimization , 2014, IEEE Transactions on Evolutionary Computation.

[2]  Gexiang Zhang,et al.  Super-fit Multicriteria Adaptive Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Graham J. Williams,et al.  Big Data Opportunities and Challenges: Discussions from Data Analytics Perspectives [Discussion Forum] , 2014, IEEE Computational Intelligence Magazine.

[4]  Shu-Mei Guo,et al.  Enhancing Differential Evolution Utilizing Eigenvector-Based Crossover Operator , 2015, IEEE Transactions on Evolutionary Computation.

[5]  Gonzalo Mateos,et al.  Modeling and Optimization for Big Data Analytics: (Statistical) learning tools for our era of data deluge , 2014, IEEE Signal Processing Magazine.

[6]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[7]  Ruhul A. Sarker,et al.  Self-adaptive differential evolution incorporating a heuristic mixing of operators , 2013, Comput. Optim. Appl..

[8]  Arthur C. Sanderson,et al.  JADE: Adaptive Differential Evolution With Optional External Archive , 2009, IEEE Transactions on Evolutionary Computation.

[9]  J. Manyika.  Big data: The next frontier for innovation, competition, and productivity , 2011 .

[10]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[11]  Ruhul A. Sarker,et al.  An Improved Self-Adaptive Differential Evolution Algorithm for Optimization Problems , 2013, IEEE Transactions on Industrial Informatics.

[12]  Charles S. Newton,et al.  Evolutionary Optimization (Evopt): A Brief Review And Analysis , 2003, Int. J. Comput. Intell. Appl..

[13]  P. N. Suganthan,et al.  Differential Evolution Algorithm With Strategy Adaptation for Global Numerical Optimization , 2009, IEEE Transactions on Evolutionary Computation.

[14]  Janez Brest,et al.  Self-Adapting Control Parameters in Differential Evolution: A Comparative Study on Numerical Benchmark Problems , 2006, IEEE Transactions on Evolutionary Computation.

[15]  Ruhul A. Sarker,et al.  Multi-operator based evolutionary algorithms for solving constrained optimization problems , 2011, Comput. Oper. Res..

[16]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[17]  Mehmet Fatih Tasgetiren,et al.  Differential evolution algorithm with ensemble of parameters and mutation strategies , 2011, Appl. Soft Comput..

[18]  Janez Brest,et al.  Population Reduction Differential Evolution with Multiple Mutation Strategies in Real World Industry Challenges , 2012, ICAISC.

[19]  Ruhul A. Sarker,et al.  Testing united multi-operator evolutionary algorithms on the CEC2014 real-parameter numerical optimization , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[20]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[21]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[22]  Seref Sagiroglu,et al.  Big data: A review , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[23]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[24]  Jingtong Hu,et al.  Write Mode Aware Loop Tiling for High Performance Low Power Volatile PCM in Embedded Systems , 2016, IEEE Trans. Computers.

[25]  Alex S. Fukunaga,et al.  Success-history based parameter adaptation for Differential Evolution , 2013, 2013 IEEE Congress on Evolutionary Computation.

[26]  Abdullah Al Mamun,et al.  Decompositional independent component analysis using multi-objective optimization , 2016, Soft Comput..

[27]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[28]  Tae Jong Choi,et al.  An Adaptive Cauchy Differential Evolution Algorithm with Population Size Reduction and Modified Multiple Mutation Strategies , 2015 .

[29]  Xin Yao,et al.  Scalability of generalized adaptive differential evolution for large-scale continuous optimization , 2010, Soft Comput..

[30]  Samuel Madden,et al.  From Databases to Big Data , 2012, IEEE Internet Comput..

[31]  Qingfu Zhang,et al.  Differential Evolution With Composite Trial Vector Generation Strategies and Control Parameters , 2011, IEEE Transactions on Evolutionary Computation.

[32]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[33]  Hussein A. Abbass,et al.  Adaptive Cross-Generation Differential Evolution Operators for Multiobjective Optimization , 2016, IEEE Transactions on Evolutionary Computation.

[34]  Lixin Tang,et al.  Differential Evolution With an Individual-Dependent Mechanism , 2015, IEEE Transactions on Evolutionary Computation.

[35]  Alex S. Fukunaga,et al.  Evaluating the performance of SHADE on CEC 2013 benchmark problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[36]  Jing Liu,et al.  A multi-agent genetic algorithm for big optimization problems , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[37]  Josef Tvrdík,et al.  Competitive differential evolution for constrained problems , 2010, IEEE Congress on Evolutionary Computation.

[38]  Josef Tvrdík,et al.  Competitive differential evolution applied to CEC 2013 problems , 2013, 2013 IEEE Congress on Evolutionary Computation.

[39]  Jason Sheng-Hong Tsai,et al.  Improving Differential Evolution With a Successful-Parent-Selecting Framework , 2015, IEEE Transactions on Evolutionary Computation.