High performance parallel evolutionary algorithm model based on MapReduce framework

Evolutionary algorithms EAs are increasingly being applied to large-scale problems. MapReduce is a powerful abstraction proposed by Google for making scalable and fault tolerant applications. However, how to design high performance parallel EA based on MapReduce MR-PEA is still an open problem. In this paper, a parallel evolutionary algorithm model based on MapReduce by improving traditional parallel evolutionary algorithms model is proposed. The MR-PEA model is fit for large populations and datasets, has the characteristic of high scalable and efficiency. In order to justify the effectiveness of the MR-PEA model, we proposed a parallel gene expression programming based on MapReduce MR-GEP used to solve symbolic regression.

[1]  Kevin D. Seppi,et al.  Parallel PSO using MapReduce , 2007, 2007 IEEE Congress on Evolutionary Computation.

[2]  Du Xin,et al.  Parallel Gene Expression Programming Based on EDA , 2010 .

[3]  K. S. Chaudhuri,et al.  Selecting informative rules with parallel genetic algorithm in classification problem , 2011, Appl. Math. Comput..

[4]  Ching-Chih Tsai,et al.  Parallel Elite Genetic Algorithm and Its Application to Global Path Planning for Autonomous Robot Navigation , 2011, IEEE Transactions on Industrial Electronics.

[5]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[6]  Xu You.  The Development of Parallel Evolutionary Algorithms , 2005 .

[7]  El-Ghazali Talbi,et al.  A parallel hybrid genetic algorithm for protein structure prediction on the computational grid , 2007, Future Gener. Comput. Syst..

[8]  Ralf Lämmel,et al.  Google's MapReduce programming model - Revisited , 2007, Sci. Comput. Program..

[9]  Lixin Ding,et al.  Asynchronous Distributed Parallel Gene Expression Programming Based on Estimation of Distribution Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[10]  Jukka Kääriäinen,et al.  Get a grip on your distributed software development with application lifecycle management , 2011, Int. J. Comput. Appl. Technol..

[11]  F. Villegas.  Parallel Genetic-Algorithm Optimization of Shaped Beam Coverage Areas Using Planar 2-D Phased Arrays , 2007, IEEE Transactions on Antennas and Propagation.

[12]  Dong Wen.  The Application and Parallel Realization of Evolutionary Optimization of Simulation , 2002 .

[13]  Jian Peng,et al.  Task scheduling algorithm based on improved genetic algorithm in cloud computing environment , 2011 .

[14]  Rajkumar Buyya,et al.  MRPGA: An Extension of MapReduce for Parallelizing Genetic Algorithms , 2008, 2008 IEEE Fourth International Conference on eScience.

[15]  Sanjay Ghemawat,et al.  MapReduce: a flexible data processing tool , 2010, CACM.

[16]  Sun You.  For Constrained Non-Linear Programming:Chaotic Parallel Genetic Algorithm with Feedback , 2007 .

[17]  Fang Dong,et al.  QoS Preference-Aware Replica Selection Strategy Using MapReduce-Based PGA in Data Grids , 2011, 2011 International Conference on Parallel Processing.

[18]  Izudin Dzafic,et al.  High performance power flow algorithm for symmetrical distribution networks with unbalanced loading , 2012, Int. J. Comput. Appl. Technol..

[19]  Li Li,et al.  An improved multi-objective ant colony algorithm for building life cycle energy consumption optimisation , 2012, Int. J. Comput. Appl. Technol..

[20]  Salman Yussof,et al.  A Coarse-Grained Parallel Genetic Algorithm with Migration for Shortest Path Routing Problem , 2009, 2009 11th IEEE International Conference on High Performance Computing and Communications.

[21]  Chi Zhou.  Fast parallelization of differential evolution algorithm using MapReduce , 2010, GECCO '10.

[22]  Xavier Llorà,et al.  Scaling Genetic Algorithms Using MapReduce , 2009, 2009 Ninth International Conference on Intelligent Systems Design and Applications.

[23]  Xavier Llorà,et al.  Scaling eCGA model building via data-intensive computing , 2010, IEEE Congress on Evolutionary Computation.

[24]  Kang Li.  ASYNCHRONOUS PARALLEL EVOLUTIONARY ALGORITHM FOR FUNCTION OPTIMIZATION , 2001 .