A Collaborative Neurodynamic Approach to Multiple-Objective Distributed Optimization

This paper is concerned with multiple-objective distributed optimization. Based on objective weighting and decision space decomposition, a collaborative neurodynamic approach to multiobjective distributed optimization is presented. In the approach, a system of collaborative neural networks is developed to search for Pareto optimal solutions, where each neural network is associated with one objective function and given constraints. Sufficient conditions are derived for ascertaining the convergence to a Pareto optimal solution of the collaborative neurodynamic system. In addition, it is proved that each connected subsystem can generate a Pareto optimal solution when the communication topology is disconnected. Then, a switching-topology-based method is proposed to compute multiple Pareto optimal solutions for discretized approximation of Pareto front. Finally, simulation results are discussed to substantiate the performance of the collaborative neurodynamic approach. A portfolio selection application is also given.

[1]  Gang Feng,et al.  Development and Analysis of a Neural Dynamical Approach to Nonlinear Programming Problems , 2007, IEEE Transactions on Automatic Control.

[2]  Alberto Bemporad,et al.  Multiobjective model predictive control , 2009, Autom..

[3]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[4]  Shouyang Wang,et al.  Distributed continuous-time approximate projection protocols for shortest distance optimization problems , 2015, Autom..

[5]  Qingshan Liu,et al.  A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization , 2017, IEEE Transactions on Automatic Control.

[6]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[7]  Farshad Kowsary,et al.  Multi-objective optimization of the building energy performance: A simulation-based approach by means of particle swarm optimization (PSO) , 2016 .

[8]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  Qingshan Liu,et al.  A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization , 2012, Neural Networks.

[11]  Hedy Attouch,et al.  A dynamic gradient approach to Pareto optimization with nonsmooth convex objective functions , 2014, 1406.1694.

[12]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[13]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[14]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[15]  Qingfu Zhang,et al.  Multiobjective evolutionary algorithms: A survey of the state of the art , 2011, Swarm Evol. Comput..

[16]  R. K. Ursem.  Multi-objective Optimization using Evolutionary Algorithms , 2009 .

[17]  Brian Dandurand,et al.  Distributed Computation of Pareto Sets , 2015, SIAM J. Optim..

[18]  R. Marler,et al.  The weighted sum method for multi-objective optimization: new insights , 2010 .

[19]  Sonia Martínez,et al.  On Distributed Convex Optimization Under Inequality and Equality Constraints , 2010, IEEE Transactions on Automatic Control.

[20]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[21]  Milan Zeleny,et al.  Multiple Criteria Decision Making , 1973 .

[22]  Qingshan Liu,et al.  A Collective Neurodynamic Approach to Distributed Constrained Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Pirja Heiskanen,et al.  Decentralized method for computing Pareto solutions in multiparty negotiations , 1999, Eur. J. Oper. Res..

[24]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[25]  Qingshan Liu,et al.  Finite-Time Convergent Recurrent Neural Network With a Hard-Limiting Activation Function for Constrained Optimization With Piecewise-Linear Objective Functions , 2011, IEEE Transactions on Neural Networks.

[26]  Qingshan Liu,et al.  Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  François Maréchal,et al.  Techno–economic design of hybrid electric vehicles and possibilities of the multi-objective optimization structure , 2016 .

[28]  Qingshan Liu,et al.  Multiple-objective optimization based on a two-time-scale neurodynamic system , 2016, 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI).

[29]  Goal Programming and Multiple Objective Optimization , 2022 .

[30]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[31]  Ali H. Sayed,et al.  Distributed Pareto Optimization via Diffusion Strategies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[32]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[33]  Bernhard Sendhoff,et al.  Pareto-Based Multiobjective Machine Learning: An Overview and Case Studies , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Jun Wang,et al.  A general projection neural network for solving monotone variational inequalities and related optimization problems , 2004, IEEE Transactions on Neural Networks.

[35]  Jun Wang,et al.  A collective neurodynamic optimization approach to bound-constrained nonconvex optimization , 2014, Neural Networks.

[36]  John J. Hopfield,et al.  Simple 'neural' optimization networks: An A/D converter, signal decision circuit, and a linear programming circuit , 1986 .

[37]  Shouyang Wang,et al.  Approximate representation of the Pareto frontier in multiparty negotiations: Decentralized methods and privacy preservation , 2016, Eur. J. Oper. Res..

[38]  Jun Wang,et al.  A Collective Neurodynamic Approach to Constrained Global Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Mohammed Mestari,et al.  Solving Nonlinear Equality Constrained Multiobjective Optimization Problems Using Neural Networks , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[41]  Qingshan Liu,et al.  A Projection Neural Network for Constrained Quadratic Minimax Optimization , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Michel Feidt,et al.  Thermodynamic analysis and evolutionary algorithm based on multi-objective optimization of performance for irreversible four-temperature-level refrigeration , 2015 .

[43]  Youshen Xia,et al.  An Extended Projection Neural Network for Constrained Optimization , 2004, Neural Computation.

[44]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[45]  Norman Biggs.  Algebraic Graph Theory: Index , 1974 .

[46]  Xiaolin Hu,et al.  An Alternative Recurrent Neural Network for Solving Variational Inequalities and Related Optimization Problems , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[47]  Sonia Martínez,et al.  Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication , 2014, Autom..

[48]  Ulf Schlichtmann,et al.  A Successive Approach to Compute the Bounded Pareto Front of Practical Multiobjective Optimization Problems , 2009, SIAM J. Optim..

[49]  Jun Wang,et al.  A Bi-Projection Neural Network for Solving Constrained Quadratic Optimization Problems , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[50]  Tingwen Huang,et al.  One-Layer Continuous-and Discrete-Time Projection Neural Networks for Solving Variational Inequalities and Related Optimization Problems , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[51]  Elizabeth F. Wanner,et al.  On a Stochastic Differential Equation Approach for Multiobjective Optimization up to Pareto-Criticality , 2011, EMO.

[52]  Qingshan Liu,et al.  A One-Layer Projection Neural Network for Nonsmooth Optimization Subject to Linear Equalities and Bound Constraints , 2013, IEEE Transactions on Neural Networks and Learning Systems.