A multi-objective neural network trained with differential evolution for dynamic economic emission dispatch

Abstract Multi-objective optimisation has received considerable attention in recent years as many real world problems have multiple conflicting objectives. There is an additional layer of complexity when considering multi-objective problems in dynamic environments due to the changing nature of the problem. A novel Multi-Objective Neural Network trained with Differential Evolution (MONNDE) is presented in this research. MONNDE utilizes Neural Network function approximators to address dynamic multi-objective optimisation problems. Differential Evolution (DE) is a state of the art single objective global optimisation problems and will be used to evolve neural networks capable of generating Pareto fronts. The proposed MONNDE algorithm has the added advantage of developing an approximation of the problem that can produce further Pareto fronts as the environment changes with no further optimisation needed. The MONNDE framework is applied to the Dynamic Economic Emission Dispatch (DEED) problem and performs equally optimal when compared to other state of the art algorithms in terms of the 24 h cost and emissions. This research also compares the performance of fully and partially connected networks and discovers that dynamically optimising the topology of the neural networks performs better in an online learning environment than simply optimising the network weights.

[1]  Provas Kumar Roy,et al.  A multi-objective hybrid evolutionary algorithm for dynamic economic emission load dispatch , 2016 .

[2]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[3]  Ali Ghasemi,et al.  A fuzzified multi objective Interactive Honey Bee Mating Optimization for Environmental/Economic Power Dispatch with valve point effect , 2013 .

[4]  Sakti Prasad Ghoshal,et al.  Solution of combined economic and emission dispatch problems of power systems by an opposition-based harmony search algorithm , 2012 .

[5]  Hadi Hamedi,et al.  Solving the combined economic load and emission dispatch problems using new heuristic algorithm , 2013 .

[6]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[7]  Hao Wang,et al.  Dynamic environmental economic dispatch using multiobjective differential evolution algorithm with expanded double selection and adaptive random restart , 2013 .

[8]  Manjaree Pandit,et al.  An improved bacterial foraging algorithm for combined static/dynamic environmental economic dispatch , 2012, Appl. Soft Comput..

[9]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[10]  Zhi-gang Lu,et al.  Low-carbon emission/economic power dispatch using the multi-objective bacterial colony chemotaxis optimization algorithm considering carbon capture power plant , 2013 .

[11]  Taher Niknam,et al.  $\theta$-Multiobjective Teaching–Learning-Based Optimization for Dynamic Economic Emission Dispatch , 2012, IEEE Systems Journal.

[12]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[13]  Dong Yue,et al.  Multi-elite guide hybrid differential evolution with simulated annealing technique for dynamic economic emission dispatch , 2015, Appl. Soft Comput..

[14]  Jim Duggan,et al.  A task allocation optimizer for software construction , 2004, IEEE Software.

[15]  Pierluigi Siano,et al.  Smart real-time scheduling of generating units in an electricity market considering environmental aspects and physical constraints of generators , 2017 .

[16]  David A. Elizondo,et al.  A Survey of Partially Connected Neural Networks , 1997, Int. J. Neural Syst..

[17]  Provas Kumar Roy,et al.  Multi-objective quasi-oppositional teaching learning based optimization for economic emission load dispatch problem , 2013 .

[18]  Sam Devlin,et al.  Policy invariance under reward transformations for multi-objective reinforcement learning , 2017, Neurocomputing.

[19]  Jan K. Sykulski,et al.  An improved Pattern Search based algorithm to solve the Dynamic Economic Dispatch problem with valve-point effect , 2010 .

[20]  Malabika Basu,et al.  Particle Swarm Optimization Based Goal-Attainment Method for Dynamic Economic Emission Dispatch , 2006 .

[21]  Xiaohua Xia,et al.  Multi-objective dynamic economic emission dispatch of electric power generation integrated with game theory based demand response programs , 2015 .

[22]  Karl Mason,et al.  Exploring avoidance strategies and neighbourhood topologies in particle swarm optimisation , 2016 .

[23]  S. Baskar,et al.  Application of modified NSGA-II algorithm to Combined Economic and Emission Dispatch problem , 2011 .

[24]  Jim Duggan,et al.  A meta optimisation analysis of particle swarm optimisation velocity update equations for watershed management learning , 2018, Appl. Soft Comput..

[25]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[26]  Fouad Ben Abdelaziz,et al.  Multi-objective stochastic programming for portfolio selection , 2007, Eur. J. Oper. Res..

[27]  David W. Corne,et al.  Approximating the Nondominated Front Using the Pareto Archived Evolution Strategy , 2000, Evolutionary Computation.

[28]  Yong Zhang,et al.  Environmental/economic power dispatch using a hybrid multi-objective optimization algorithm , 2010 .

[29]  Ahmed M. Elaiw,et al.  Hybrid DE-SQP and hybrid PSO-SQP methods for solving dynamic economic emission dispatch problem with valve-point effects , 2013 .

[30]  Jim Duggan,et al.  Using System Dynamics and Multiple Objective Optimization to Support Policy Analysis for Complex Systems , 2008 .

[31]  Stefan Reis,et al.  Twenty-five years of continuous sulphur dioxide emission reduction in Europe , 2007 .

[32]  Joni-Kristian Kämäräinen,et al.  Differential Evolution Training Algorithm for Feed-Forward Neural Networks , 2003, Neural Processing Letters.

[33]  Vo Ngoc Dieu,et al.  Augmented Lagrange Hopfield network initialized by quadratic programming for economic dispatch with piecewise quadratic cost functions and prohibited zones , 2013, Appl. Soft Comput..

[34]  Jim Duggan,et al.  Multi-objective dynamic economic emission dispatch using particle swarm optimisation variants , 2017, Neurocomputing.

[35]  Dinu Calin Secui,et al.  A new modified artificial bee colony algorithm for the economic dispatch problem , 2015 .

[36]  Andreas Zell,et al.  Optimizing recurrent reservoirs with neuro-evolution , 2016, Neurocomputing.

[37]  Malabika Basu,et al.  Dynamic economic emission dispatch using nondominated sorting genetic algorithm-II , 2008 .

[38]  Mousumi Basu,et al.  Dynamic Economic Emission Dispatch Using Evolutionary Programming and Fuzzy Satisfying Method , 2007 .

[39]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[40]  George W. Irwin,et al.  An efficient harmony search with new pitch adjustment for dynamic economic dispatch , 2014 .

[41]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[42]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[43]  Lixiang Li,et al.  A multi-objective chaotic ant swarm optimization for environmental/economic dispatch , 2010 .

[44]  Waree Kongprawechnon,et al.  Application of multiple tabu search algorithm to solve dynamic economic dispatch considering generator constraints , 2008 .

[45]  Prakash Kumar Hota,et al.  Economic emission load dispatch through fuzzy based bacterial foraging algorithm , 2010 .

[46]  Pei-Chann Chang,et al.  A novel model by evolving partially connected neural network for stock price trend forecasting , 2012, Expert Syst. Appl..

[47]  Zhicheng Ji,et al.  A novel hybrid particle swarm optimization and gravitational search algorithm for solving economic emission load dispatch problems with various practical constraints , 2014 .

[48]  J. P. Zhan,et al.  Dynamic economic emission dispatch based on group search optimizer with multiple producers , 2012 .

[49]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .