A hybrid adaptive evolutionary algorithm in the domination-based and decomposition-based frameworks of multi-objective optimization

Under the framework of evolutionary paradigms, many variations of evolutionary algorithms have been designed. Each of the algorithms performs well in certain cases and none of them are dominating one another. This study is based on the idea of synthesizing different evolutionary algorithms so as to complement the limitations of each algorithm. On top of this idea, this paper proposes an adaptive mechanism that synthesizes a genetic algorithm, differential evolution and estimation of distribution algorithm. The adaptive mechanism takes into account the ratio of the number of promising solutions generated from each optimizer in an early stage of evolutions so as to determine the proportion of the number of solutions to be produced by each optimizer in the next generation. Furthermore, the adaptive algorithm is also hybridized with the evolutionary gradient search to further enhance its search ability. The proposed hybrid adaptive algorithm is developed in the domination-based and decomposition-based multi-objective frameworks. An extensive experimental study is carried out to test the performances of the proposed algorithms in 38 state-of-the-art benchmark test instances.

[1]  Kok Kiong Tan,et al.  Computation delay compensation for real time implementation of robust model predictive control , 2012, IEEE 10th International Conference on Industrial Informatics.

[2]  K.K. Tan,et al.  Friction Modelling of Servomechanical Systems with Dual-relay Feedback , 2007, IECON 2007 - 33rd Annual Conference of the IEEE Industrial Electronics Society.

[3]  Kok Kiong Tan,et al.  Automated Fault Detection and Diagnosis in Mechanical Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Xiaodong Wu,et al.  Real-time estimation and control of photoresist properties in microlithography , 2007, 2007 IEEE International Conference on Control Applications.

[5]  Si-Lu Chen,et al.  Two-Layer Binary Tree Data-Driven Model for Valve Stiction , 2008 .

[6]  Edmondo A. Minisci,et al.  MOPED: A Multi-objective Parzen-Based Estimation of Distribution Algorithm for Continuous Problems , 2003, EMO.

[7]  Marco Laumanns,et al.  Scalable multi-objective optimization test problems , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[8]  Chek Sing Teo,et al.  Dynamic Geometric Compensation for Gantry Stage using Iterative Learning Control , 2006, IECON 2006 - 32nd Annual Conference on IEEE Industrial Electronics.

[9]  Kok Kiong Tan,et al.  Comments on "Output feedback model predictive control for LPV systems based on quasi-min-max algorithm" , 2012, Autom..

[10]  Arthur Tay,et al.  Piezo-Assisted Intra-Cytoplasmic Sperm Injection: A Comparative Study of Two Penetration Techniques , 2007, 2007 IEEE International Conference on Control Applications.

[11]  T S Giam,et al.  Precision coordinated control of multi-axis gantry stages. , 2007, ISA transactions.

[12]  Kok Kiong Tan,et al.  Design, Modeling, and Control of Piezoelectric Actuators for Intracytoplasmic Sperm Injection , 2007, IEEE Transactions on Control Systems Technology.

[13]  Riccardo Poli,et al.  Evolving Problems to Learn About Particle Swarm Optimizers and Other Search Algorithms , 2006, IEEE Transactions on Evolutionary Computation.

[14]  Saku Kukkonen,et al.  Real-parameter optimization with differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[15]  Kok Kiong Tan,et al.  Fault Diagnosis and Fault-Tolerant Control in Linear Drives Using the Kalman Filter , 2012, IEEE Transactions on Industrial Electronics.

[16]  Kok Kiong Tan,et al.  Cutting force control of milling machine , 2007 .

[17]  Kok Kiong Tan,et al.  Intelligent Friction Modeling and Compensation Using Neural Network Approximations , 2012, IEEE Transactions on Industrial Electronics.

[18]  R. Lyndon While,et al.  A review of multiobjective test problems and a scalable test problem toolkit , 2006, IEEE Transactions on Evolutionary Computation.

[19]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[20]  K. Tan,et al.  Limit Cycles in a Class of Systems under PID-type of Relay Feedback , 2007, Annual Conference of the IEEE Industrial Electronics Society.

[21]  Si-Lu Chen,et al.  Relay-based force ripple and friction modeling for the permanent magnet linear motor , 2008, 2008 10th International Conference on Control, Automation, Robotics and Vision.

[22]  David Bull,et al.  Proceedings of SPIE - The International Society for Optical Engineering , 2007 .

[23]  Chek Sing Teo,et al.  Dynamic modeling and adaptive control of a H-type gantry stage , 2007 .

[24]  Mícheál Ó Foghlú,et al.  Frequent Closed Informative Itemset Mining , 2007 .

[25]  Kok Kiong Tan,et al.  Vision-assisted thermal monitoring system for CNC machine surveillance , 2008, 2008 IEEE International Conference on Automation and Logistics.

[26]  Si-Lu Chen,et al.  SVD-based Preisach hysteresis identification and composite control of piezo actuators. , 2012, ISA transactions.

[27]  Kok Kiong Tan,et al.  Self-Sensing Actuation With Adaptive Control in Applications With Switching Trajectory , 2008, IEEE/ASME Transactions on Mechatronics.

[28]  Qingfu Zhang,et al.  Multiobjective optimization Test Instances for the CEC 2009 Special Session and Competition , 2009 .

[29]  Kay Chen Tan,et al.  An investigation on evolutionary gradient search for multi-objective optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[30]  Kok Kiong Tan,et al.  Adaptive neural network algorithm for control design of rigid-link electrically driven robots , 2008, Neurocomputing.

[31]  Jouni Lampinen,et al.  DE’s Selection Rule for Multiobjective Optimization , 2001 .

[32]  Kay Chen Tan,et al.  Restricted Boltzmann machine based algorithm for multi-objective optimization , 2010, IEEE Congress on Evolutionary Computation.

[33]  Chek Sing Teo,et al.  Controller design of eddy current braking in an air bearing system , 2012, Autom..

[34]  Kay Chen Tan,et al.  A Multiobjective Memetic Algorithm Based on Particle Swarm Optimization , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[36]  Kok Kiong Tan,et al.  Predictive Ratio Control of Multizone Thermal Processing System in Lithography , 2008 .

[37]  David E. Goldberg,et al.  Multiobjective hBOA, clustering, and scalability , 2005, GECCO '05.

[38]  Marco Laumanns,et al.  Performance assessment of multiobjective optimizers: an analysis and review , 2003, IEEE Trans. Evol. Comput..

[39]  K. Z. Tang,et al.  Development of a computer-controlled intelligent physiotherapy system , 2008 .

[40]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[41]  Abdullah Al Mamun,et al.  Development of a Spherical Air Bearing Positioning System , 2012, IEEE Transactions on Industrial Electronics.

[42]  Zhang Yi,et al.  Stability and Chaos of a Class of Learning Algorithms for ICA Neural Networks , 2008, Neural Processing Letters.

[43]  Andrzej Jaszkiewicz,et al.  On the performance of multiple-objective genetic local search on the 0/1 knapsack problem - a comparative experiment , 2002, IEEE Trans. Evol. Comput..

[44]  Kalyanmoy Deb,et al.  Real-coded Genetic Algorithms with Simulated Binary Crossover: Studies on Multimodal and Multiobjective Problems , 1995, Complex Syst..

[45]  Jouni Lampinen,et al.  An Extension of Generalized Differential Evolution for Multi-objective Optimization with Constraints , 2004, PPSN.

[46]  Xiaoping Zhong,et al.  A Decision-Tree-Based Multi-objective Estimation of Distribution Algorithm , 2007, 2007 International Conference on Computational Intelligence and Security (CIS 2007).

[47]  Kay Chen Tan,et al.  A predictive gradient strategy for multiobjective evolutionary algorithms in a fast changing environment , 2010, Memetic Comput..

[48]  Kok Kiong Tan,et al.  Decentralized adaptive controller design of large-scale uncertain robotic systems , 2009, Autom..

[49]  Hussein A. Abbass,et al.  The Pareto Differential Evolution Algorithm , 2002, Int. J. Artif. Intell. Tools.

[50]  Zhang Yi,et al.  Software Based Vision System for Automated Cell Injection , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[51]  Xiaodong Li,et al.  Solving Rotated Multi-objective Optimization Problems Using Differential Evolution , 2004, Australian Conference on Artificial Intelligence.

[52]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[53]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[54]  Kok Kiong Tan,et al.  Adaptive Control of Mechanical Systems Using Neural Networks , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[55]  Kok Kiong Tan,et al.  Compensation of nonlinearities in a piezoelectric stack actuator with application in intra-cytoplasmic sperm injection , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[56]  Jouni Lampinen,et al.  GDE3: the third evolution step of generalized differential evolution , 2005, 2005 IEEE Congress on Evolutionary Computation.

[57]  Kok Kiong Tan,et al.  Fault Detection and Accommodation Control for a Class of Nonlinear Systems , 2008 .

[58]  Eckart Zitzler,et al.  Evolutionary algorithms for multiobjective optimization: methods and applications , 1999 .

[59]  Geoffrey E. Hinton.  What kind of graphical model is the brain? , 2005, IJCAI.

[60]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[61]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[62]  C. W. de Silva,et al.  Tool wear detection and fault diagnosis based on cutting force monitoring , 2007 .

[63]  Vui Ann Shim,et al.  Evolutionary algorithms for solving multi-objective travelling salesman problem , 2011 .

[64]  Thomas Stützle,et al.  A Two-Phase Local Search for the Biobjective Traveling Salesman Problem , 2003, EMO.

[65]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[66]  Kok Kiong Tan,et al.  Evaluation and optimization of passive vibration controller design for flexible beams , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[67]  K. K. Tan,et al.  Mobile real-time feedback system for education , 2008 .