Parallel Single and Multiple Objectives Genetic Algorithms: A Survey

This paper critically reviews the reported research on parallel single and multi-objective genetic algorithms. Many early efforts on single and multi-objective genetic algorithms were introduced to reduce the processing time needed to reach an acceptable solution. However, some parallel single and multi-objective genetic algorithms converged to better solutions as compared to comparable sequential single and multiple objective genetic algorithms. The authors review several representative models for parallelizing single and multi-objective genetic algorithms. Further, some of the issues that have not yet been studied systematically are identified in the context of parallel single and parallel multi-objective genetic algorithms. Finally, some of the potential applications of parallel multi-objective GAs are discussed.

[1]  Andreas Zell,et al.  Parallelization of Multi-objective Evolutionary Algorithms Using Clustering Algorithms , 2005, EMO.

[2]  J. Dennis,et al.  A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , 1997 .

[3]  Vipin Kumar,et al.  Isoefficiency: measuring the scalability of parallel algorithms and architectures , 1993, IEEE Parallel & Distributed Technology: Systems & Applications.

[4]  Qiuwang Wang,et al.  Application of a Genetic Algorithm for Thermal Design of Fin-and-Tube Heat Exchangers , 2008 .

[5]  Mitsuo Gen,et al.  Scheduling algorithm for real-time tasks using multiobjective hybrid genetic algorithm in heterogeneous multiprocessors system , 2007, Comput. Oper. Res..

[6]  You-Lian Zheng,et al.  New progresses and prospect of multi-objective evolutionary algorithm , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[7]  Raymond Y. K. Lau,et al.  A Parallel Genetic Algorithm for Floorplan Area Optimization , 2007, Seventh International Conference on Intelligent Systems Design and Applications (ISDA 2007).

[8]  Hisao Ishibuchi,et al.  Incorporation of decision maker's preference into evolutionary multiobjective optimization algorithms , 2006, GECCO '06.

[9]  Gary B. Lamont,et al.  Multiobjective Evolutionary Algorithms: Analyzing the State-of-the-Art , 2000, Evolutionary Computation.

[10]  Chia-Hung Wei,et al.  Techniques for Content-Based Multimedia Retrieval , 2011 .

[11]  Richard Balling,et al.  The Maximin Fitness Function; Multi-objective City and Regional Planning , 2003, EMO.

[12]  Bhabani Shankar Prasad Mishra,et al.  Parallel multi-objective genetic algorithms for associative classification rule mining , 2011, ICCCS '11.

[13]  Harold Soh,et al.  moPGA: Towards a New Generation of Multi-objective Genetic Algorithms , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[14]  Rajeev Kumar,et al.  Improved Sampling of the Pareto-Front in Multiobjective Genetic Optimizations by Steady-State Evolution: A Pareto Converging Genetic Algorithm , 2002, Evolutionary Computation.

[15]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[16]  Gang Ju,et al.  A parallel genetic algorithm in multi-objective optimization , 2009, 2009 Chinese Control and Decision Conference.

[17]  Peter J. Fleming,et al.  Genetic Algorithms for Multiobjective Optimization: FormulationDiscussion and Generalization , 1993, ICGA.

[18]  Hao Ju.  A study of genetic algorithm based on isolation niche technique , 2000 .

[19]  Carlos A. Coello Coello,et al.  MRMOGA: a new parallel multi-objective evolutionary algorithm based on the use of multiple resolutions: Research Articles , 2007 .

[20]  David E. Goldberg,et al.  Hierarchical Problem Solving and the Bayesian Optimization Algorithm , 2000, GECCO.

[21]  Reiko Tanese,et al.  Parallel Genetic Algorithms for a Hypercube , 1987, ICGA.

[22]  Mariem Gzara,et al.  Parallel Multi-Objective Evolutionary Algorithm with Multi-Front Equitable Distribution , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing (GCC'06).

[23]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[24]  Liu Sheng.  An improved adaptive genetic algorithm and its application in function optimization , 2007 .

[25]  David Corne,et al.  The Pareto archived evolution strategy: a new baseline algorithm for Pareto multiobjective optimisation , 1999, Proceedings of the 1999 Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406).

[26]  Erick Cantú-Paz,et al.  A Survey of Parallel Genetic Algorithms , 2000 .

[27]  Enrique Alba,et al.  Improving flexibility and efficiency by adding parallelism to genetic algorithms , 2002, Stat. Comput..

[28]  Francisco Sandoval Hernández,et al.  Genetic Algorithms on LAN-message Passing Architectures using PVM: Application to the Routing Problem , 1994, PPSN.

[29]  Michel Gourgand,et al.  Sequential and Parallel Genetic Algorithms for the Hybrid Flow Shop Scheduling Problem , 2006 .

[30]  Jing J. Liang,et al.  Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems , 2006, Int. J. Intell. Syst..

[31]  Gisele L. Pappa.  Multiobjective Genetic Algorithms for Attribute Selection , 2002 .

[32]  Carlos A. Coello Coello,et al.  MRMOGA: parallel evolutionary multiobjective optimization using multiple resolutions , 2005, 2005 IEEE Congress on Evolutionary Computation.

[33]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[34]  Xu Lihong.  A Dynamic Niche Genetic Algorithm for Multimodal Function Optimization , 2006 .

[35]  Guo Liang-min.  An Improved Multi-objective Evolutionary Algorithm Based on Crowing Mechanism , 2006 .

[36]  Enrique Alba,et al.  Analyzing synchronous and asynchronous parallel distributed genetic algorithms , 2001, Future Gener. Comput. Syst..

[37]  Reiko Tanese,et al.  Distributed Genetic Algorithms , 1989, ICGA.

[38]  Antonio J. Conejo,et al.  A Parallel Repair Genetic Algorithm to Solve the Unit Commitment Problem , 2002, IEEE Power Engineering Review.

[39]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[40]  P. Hajela,et al.  Genetic search strategies in multicriterion optimal design , 1991 .

[41]  Tomoyuki Hiroyasu,et al.  MOGADES: Multi-Objective Genetic Algorithm with Distributed Environment Scheme , 2005, Evolutionary Multiobjective Optimization.

[42]  Pingjing Yao,et al.  Study on multi-objective genetic algorithm , 2000, Proceedings of the 3rd World Congress on Intelligent Control and Automation (Cat. No.00EX393).

[43]  Riccardo Poli,et al.  Parallel genetic algorithm taxonomy , 1999, 1999 Third International Conference on Knowledge-Based Intelligent Information Engineering Systems. Proceedings (Cat. No.99TH8410).

[44]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[45]  Martin Pelikan,et al.  Hierarchical Bayesian optimization algorithm: toward a new generation of evolutionary algorithms , 2010, SICE 2003 Annual Conference (IEEE Cat. No.03TH8734).

[46]  O Alawode Kehinde,et al.  Multiobjective Optimal Power Flow Using Hybrid Evolutionary Algorithm , 2010 .

[47]  Bernard Manderick,et al.  Fine-Grained Parallel Genetic Algorithms , 1989, ICGA.

[48]  Roberto Natella,et al.  A Recovery-Oriented Approach for Software Fault Diagnosis in Complex Critical Systems , 2011, Int. J. Adapt. Resilient Auton. Syst..

[49]  H. Ishibuchi,et al.  MOGA: multi-objective genetic algorithms , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[50]  Wang Jian-jie.  Research on reactive power optimization of distribution network based on the improved crowding niche genetic algorithm , 2007 .

[51]  Anthony A. Maciejewski,et al.  A Study of Five Parallel Approaches to a Genetic Algorithm for the Traveling Salesman Problem , 2005, Intell. Autom. Soft Comput..

[52]  Carlos A. Coello Coello,et al.  Design of combinational logic circuits through an evolutionary multiobjective optimization approach , 2002, Artificial Intelligence for Engineering Design, Analysis and Manufacturing.

[53]  Enrique Alba,et al.  Heterogeneous Computing and Parallel Genetic Algorithms , 2002, J. Parallel Distributed Comput..

[54]  Carlos A. Coello Coello,et al.  A Comprehensive Survey of Evolutionary-Based Multiobjective Optimization Techniques , 1999, Knowledge and Information Systems.

[55]  Witold Pedrycz,et al.  Perspectives on Cognitive Computing and Applications , 2010, Int. J. Softw. Sci. Comput. Intell..

[56]  David Taniar,et al.  A new parallel genetic algorithm , 2002, Proceedings International Symposium on Parallel Architectures, Algorithms and Networks. I-SPAN'02.

[57]  Gara Miranda,et al.  Parallel hyperheuristic: a self-adaptive island-based model for multi-objective optimization , 2008, GECCO '08.

[58]  Yingxu Wang,et al.  The Formal Design Model of an Automatic Teller Machine (ATM) , 2010, Int. J. Softw. Sci. Comput. Intell..

[59]  Marin Golub,et al.  A new model of global parallel genetic algorithm , 2000, ITI 2000. Proceedings of the 22nd International Conference on Information Technology Interfaces (Cat. No.00EX411).

[60]  Lothar Thiele,et al.  Multiobjective Optimization Using Evolutionary Algorithms - A Comparative Case Study , 1998, PPSN.

[61]  Jose Miguel Puerta,et al.  Improving model combination through local search in parallel univariate EDAs , 2005, 2005 IEEE Congress on Evolutionary Computation.

[62]  David E. Goldberg,et al.  Multiple-Deme Parallel Estimation of Distribution Algorithms: Basic Framework and Application , 2003, PPAM.

[63]  Mehrdad Tamiz,et al.  Multi-objective meta-heuristics: An overview of the current state-of-the-art , 2002, Eur. J. Oper. Res..

[64]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[65]  Hajime Kita,et al.  Multi-Objective Optimization by Means of the Thermodynamical Genetic Algorithm , 1996, PPSN.

[66]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[67]  Chrisila C. Pettey,et al.  A Theoretical Investigation of a Parallel Genetic Algorithm , 1989, ICGA.

[68]  Lakshmi Rajamani,et al.  NON-DOMINATED RANKED GENETIC ALGORITHM FOR SOLVING MULTI-OBJECTIVE OPTIMIZATION PROBLEMS: NRGA , 2008 .

[69]  Zheng Jin-hua.  Research on cause for overlapping solutions and on their influence in NSGA-II algorithm , 2008 .

[70]  Gang Ju,et al.  A selective migration parallel multi-objective genetic algorithm , 2010, 2010 Chinese Control and Decision Conference.

[71]  E. Tarantino,et al.  A parallel genetic algorithm for transonic airfoil optimisation , 1995, Proceedings of 1995 IEEE International Conference on Evolutionary Computation.

[72]  D.A. Van Veldhuizen,et al.  On measuring multiobjective evolutionary algorithm performance , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[73]  M.H.W. Hobbs,et al.  Representing Space: A Hybrid Genetic Algorithm for Aesthetic Graph Layout , 1998 .

[74]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[75]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[76]  Miao Li,et al.  Study of population diversity of multiobjective evolutionary algorithm based on immune and entropy principles , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[77]  L. Darrell Whitley,et al.  Optimization Using Distributed Genetic Algorithms , 1990, PPSN.

[78]  Jose Miguel Puerta,et al.  Initial Approaches to the Application of Islands-Based Parallel EDAs in Continuous Domains , 2005, ICPP Workshops.

[79]  Enrique Alba,et al.  A study of master-slave approaches to parallelize NSGA-II , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[80]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[81]  Kalyanmoy Deb,et al.  Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms , 2003, EMO.

[82]  Mahmoud Naghibzadeh,et al.  Hard real-time multiobjective scheduling in heterogeneous systems using genetic algorithms , 2009, 2009 14th International CSI Computer Conference.

[83]  M. Ghiassi,et al.  A Web-Enabled, Mobile Intelligent Information Technology Architecture for On-Demand and Mass Customized Markets , 2011 .

[84]  Ponnuthurai Nagaratnam Suganthan,et al.  Comprehensive learning particle swarm optimizer for solving multiobjective optimization problems: Research Articles , 2006 .

[85]  M. N. Sulaiman,et al.  Shape Assignment by Genetic Algorithm towards Designing Optimal Areas , 2010 .

[86]  Tomoyuki Hiroyasu,et al.  DCMOGADES: distributed cooperation model of multi-objective genetic algorithm with distributed scheme , 2002 .

[87]  Juan Luis García Guirao,et al.  Petri Nets and Discrete Events Systems , 2011, Int. J. Softw. Sci. Comput. Intell..

[88]  Gary B. Lamont,et al.  A Statistical Comparison of Multiobjective Evolutionary Algorithms Including the MOMGA-II , 2001, EMO.

[89]  Qijuan Chen,et al.  An Improved Hybrid Genetic Algorithm for Solving Multi-modal Function Global Optimization Problem , 2007, 2007 IEEE International Conference on Automation and Logistics.

[90]  Tomoyuki Hiroyasu,et al.  Characteristics of Models of Parallel Genetic Algorithms on PC Cluster System. , 2002 .

[91]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[92]  Stephen L. Dyer.  A conceptual framework enabling assessment of software flexibility in business applications , 2003 .

[93]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[94]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[95]  El-Ghazali Talbi,et al.  Design of multi-objective evolutionary algorithms: application to the flow-shop scheduling problem , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[96]  Tai-hoon Kim,et al.  Application of Genetic Algorithm in Software Testing , 2009 .

[97]  Carlos A. Coello Coello,et al.  Evolutionary multi-objective optimization: a historical view of the field , 2006, IEEE Comput. Intell. Mag..

[98]  Alexander Mendiburu,et al.  Parallel and multi-objective EDAs to create multivariate calibration models for quantitative chemical applications , 2005, 2005 International Conference on Parallel Processing Workshops (ICPPW'05).

[99]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[100]  Qishi Wu,et al.  THE APPLICATION OF GENETIC ALGORITHM IN GIS NETWORK ANALYSIS , 2000 .

[101]  Carlos A. Coello Coello,et al.  Handling preferences in evolutionary multiobjective optimization: a survey , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[102]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[103]  Zhang Zhe,et al.  WIDE-AREA INTELLIGENT PROTECTION SYSTEM BASED ON GENETIC ALGORITHM , 2009 .

[104]  David Mark Levine,et al.  A parallel genetic algorithm for the set partitioning problem , 1995 .

[105]  Carlos A. Coello Coello,et al.  A Short Tutorial on Evolutionary Multiobjective Optimization , 2001, EMO.

[106]  George Baciu,et al.  Cognitive location-aware information retrieval by agent-based semantic matching , 2009, 2009 8th IEEE International Conference on Cognitive Informatics.

[107]  Jeffrey Horn,et al.  The nature of niching: genetic algorithms and the evolution of optimal, cooperative populations , 1997 .

[108]  Marco Laumanns,et al.  A Tutorial on Evolutionary Multiobjective Optimization , 2004, Metaheuristics for Multiobjective Optimisation.

[109]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[110]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[111]  Joshua D. Knowles,et al.  M-PAES: a memetic algorithm for multiobjective optimization , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[112]  Tomoyuki Hiroyasu,et al.  A parallel genetic algorithm with distributed environment scheme , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[113]  Kinshuk,et al.  Intelligent and Adaptive Learning Systems: Technology Enhanced Support for Learners and Teachers , 2011 .

[114]  Tomoyuki Hiroyasu,et al.  The new model of parallel genetic algorithm in multi-objective optimization problems - divided range multi-objective genetic algorithm , 2000, Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512).

[115]  Kenneth A. De Jong,et al.  An Analysis of the Effects of Neighborhood Size and Shape on Local Selection Algorithms , 1996, PPSN.

[116]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[117]  Gary B. Lamont,et al.  In situ bioremediation of perchlorate-contaminated groundwater using a multi-objective parallel evolutionary algorithm , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[118]  Huang Ming.  Research of an Improved Parallel Genetic Algorithm with Adjustable Migration Rate , 2009 .

[119]  J. Branke,et al.  Guidance in evolutionary multi-objective optimization , 2001 .

[120]  N. Petrick,et al.  Design of a high-sensitivity classifier based on a genetic algorithm: application to computer-aided diagnosis , 1998, Physics in medicine and biology.

[121]  K. Alagarsamy,et al.  Multi Objective Genetic Algorithm for the optimized Resource usage and the Prioritization of the Constraints in the Software project planning , 2010 .

[122]  Alexander Mendiburu,et al.  Parallel implementation of EDAs based on probabilistic graphical models , 2005, IEEE Transactions on Evolutionary Computation.

[123]  Aran Lunzer,et al.  Interdisciplinary Advances in Adaptive and Intelligent Assistant Systems: Concepts, Techniques, Applications, and Use , 2010 .

[124]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[125]  Nandish V. Patel.  Adaptive Evolutionary Information Systems , 2002 .

[126]  Kalyanmoy Deb,et al.  Parallelizing multi-objective evolutionary algorithms: cone separation , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[127]  Jeffrey Horn,et al.  The Niched Pareto Genetic Algorithm 2 Applied to the Design of Groundwater Remediation Systems , 2001, EMO.

[128]  Thomas Bäck,et al.  Evolutionary algorithms in theory and practice - evolution strategies, evolutionary programming, genetic algorithms , 1996 .

[129]  J. B. Zydallis,et al.  Explicit building-block multiobjective genetic algorithms: theory, analysis, and development , 2003 .

[130]  Andrzej Jaszkiewicz,et al.  On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - a comparative experiment , 2002, IEEE Trans. Evol. Comput..

[131]  Myungryun Yoo,et al.  Real-time task scheduling by multiobjective genetic algorithm , 2009, J. Syst. Softw..

[132]  Joaquim Peiró,et al.  Supervised Parallel Genetic Algorithms in Aerodynamic Optimisation , 1997, ICANNGA.

[133]  Ryozo Ooka,et al.  Application Multi-Objective Genetic Algorithm for Optimal Design Method of Distributed Energy System , 2009 .

[134]  Min-Chie Chiu,et al.  Application of Genetic Algorithm to the Shape Optimization of a Constrained Double-Chamber Muffler with Extended Tubes , 2004 .

[135]  Xiaodong Li,et al.  The effects of varying population density in a fine-grained parallel genetic algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[136]  Du Zhang,et al.  Inconsistency-Induced Learning for Perpetual Learners , 2011, Int. J. Softw. Sci. Comput. Intell..

[137]  Carlos A. Coello Coello,et al.  MRMOGA: a new parallel multi‐objective evolutionary algorithm based on the use of multiple resolutions , 2007, Concurr. Comput. Pract. Exp..

[138]  Enrique Alba,et al.  Parallelism and evolutionary algorithms , 2002, IEEE Trans. Evol. Comput..

[139]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[140]  Alex Alves Freitas,et al.  Attribute Selection with a Multi-objective Genetic Algorithm , 2002, SBIA.