Multi-objective optimization by learning automata

This paper presents a novel method of multi-objective optimization by learning automata (MOLA) to solve complex multi-objective optimization problems. MOLA consists of multiple automata which perform sequential search in the solution domain. Each automaton undertakes dimensional search in the selected dimension of the solution domain, and each dimension is divided into a certain number of cells. Each automaton performs a continuous search action, instead of discrete actions, within cells. The merits of MOLA have been demonstrated, in comparison with a multi-objective evolutionary algorithm based on decomposition (MOEA/D) and non-dominated sorting genetic algorithm II (NSGA-II), on eleven multi-objective benchmark functions and an optimal problem in the midwestern American electric power system which is integrated with wind power, respectively. The simulation results have shown that MOLA can obtain more accurate and evenly distributed Pareto fronts, in comparison with MOEA/D and NSGA-II.

[1]  Andrew Kusiak,et al.  Multiobjective Optimization of Temporal Processes Minimum and Maximum Values of Sets D , 2022 .

[2]  Kay Chen Tan,et al.  A competitive and cooperative co-evolutionary approach to multi-objective particle swarm optimization algorithm design , 2010, Eur. J. Oper. Res..

[3]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[4]  Frederick Mosteller,et al.  Stochastic Models for Learning , 1956 .

[5]  Qian Ai,et al.  Economic operation of wind farm integrated system considering voltage stability , 2009 .

[6]  Prabhat Hajela,et al.  Cellular genetic algorithm technique for the multicriterion design optimization , 2010 .

[7]  M. L. Tsetlin,et al.  Automaton theory and modeling of biological systems , 1973 .

[8]  Kirsten Schmieder,et al.  Registration of CT and Intraoperative 3-D Ultrasound Images of the Spine Using Evolutionary and Gradient-Based Methods , 2008, IEEE Transactions on Evolutionary Computation.

[9]  Q. Henry Wu,et al.  Multi-objective optimization by reinforcement learning for power system dispatch and voltage stability , 2010, 2010 IEEE PES Innovative Smart Grid Technologies Conference Europe (ISGT Europe).

[10]  Qingfu Zhang,et al.  The performance of a new version of MOEA/D on CEC09 unconstrained MOP test instances , 2009, 2009 IEEE Congress on Evolutionary Computation.

[11]  Harley Bornbach,et al.  An introduction to mathematical learning theory , 1967 .

[12]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[13]  T.K. Saha,et al.  Investigation of power loss and voltage stability limits for large wind farm connections to a subtransmission network , 2004, IEEE Power Engineering Society General Meeting, 2004..

[14]  M. A. L. Thathachar,et al.  Networks of Learning Automata , 2004 .

[15]  Pablo Moscato,et al.  On Evolution, Search, Optimization, Genetic Algorithms and Martial Arts : Towards Memetic Algorithms , 1989 .

[16]  Jim E. Smith,et al.  Coevolving Memetic Algorithms: A Review and Progress Report , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  Ed Keedwell,et al.  Hybridizing Cellular Automata Principles and NSGAII for Multi-objective Design of Urban Water Networks , 2006, EMO.

[18]  M. A. Abido.  Environmental/economic power dispatch using multiobjective evolutionary algorithms , 2003 .

[19]  Seyed Hamid Zahiri,et al.  A New Method for Multiobjective Optimization Based on Learning Automata , 2009 .

[20]  John S. Bridle,et al.  Training Stochastic Model Recognition Algorithms as Networks can Lead to Maximum Mutual Information Estimation of Parameters , 1989, NIPS.

[21]  J. Cidras,et al.  Modeling of wind farms in the load flow analysis , 2000 .

[22]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[23]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 2005, IEEE Transactions on Neural Networks.

[24]  Thomas Stützle,et al.  Combining Two Search Paradigms for Multi-objective Optimization: Two-Phase and Pareto Local Search , 2013, Hybrid Metaheuristics.

[25]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[26]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[27]  Q. Henry Wu,et al.  Optimal placement of FACTS devices by a Group Search Optimizer with Multiple Producer , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[28]  Timothy Gordon,et al.  Continuous action reinforcement learning applied to vehicle suspension control , 1997 .

[29]  Ferrante Neri,et al.  Integrating Cross-Dominance Adaptation in Multi-Objective Memetic Algorithms , 2009 .

[30]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.

[31]  E. Spooner,et al.  Grid Power Quality with Variable-Speed Wind Turbines , 2001, IEEE Power Engineering Review.

[32]  R. Bharathi,et al.  Optimization of combined economic and emission dispatch problem — A comparative study , 2007, 2007 International Power Engineering Conference (IPEC 2007).

[33]  Fangxing Li,et al.  A new multi-objective optimization technique for generation dispatch , 2009, 41st North American Power Symposium.

[34]  Luís Paquete,et al.  Connectedness and Local Search for Bicriteria Knapsack Problems , 2011, EvoCOP.

[35]  Pramod K. Varshney,et al.  A Multiobjective Optimization Approach to Obtain Decision Thresholds for Distributed Detection in Wireless Sensor Networks , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Mengshi Li,et al.  Mean-variance model for power system economic dispatch with wind power integrated , 2014 .

[37]  Q. H. Wu,et al.  APPLICATION OF LEARNING AUTOMATA TO CONTROLLER DESIGN IN SLOW-ACTIVE AUTOMOBILE SUSPENSIONS , 1995 .

[38]  Q. H. Wu,et al.  Function Optimization by Reinforcement Learning for power system dispatch and voltage stability , 2010, IEEE PES General Meeting.

[39]  Kwang Y. Lee,et al.  Application of S-model learning automata for multi-objective optimal operation of power systems , 2005 .

[40]  Seyed Hamid Zahiri,et al.  Data Mining Using Learning Automata , 2009 .

[41]  Joshua D. Knowles.  A summary-attainment-surface plotting method for visualizing the performance of stochastic multiobjective optimizers , 2005, 5th International Conference on Intelligent Systems Design and Applications (ISDA'05).

[42]  Peter J. Fleming,et al.  On the Performance Assessment and Comparison of Stochastic Multiobjective Optimizers , 1996, PPSN.

[43]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[44]  Kumpati S. Narendra,et al.  Learning automata - an introduction , 1989 .