A Neurodynamic Approach to Distributed Optimization With Globally Coupled Constraints

In this paper, a distributed neurodynamic approach is proposed for constrained convex optimization. The objective function is a sum of local convex subproblems, whereas the constraints of these subproblems are coupled. Each local objective function is minimized individually with the proposed neurodynamic optimization approach. Through information exchange between connected neighbors only, all nodes can reach consensus on the Lagrange multipliers of all global equality and inequality constraints, and the decision variables converge to the global optimum in a distributed manner. Simulation results of two power system cases are discussed to substantiate the effectiveness and characteristics of the proposed approach.

[1]  Xiaodong Wang,et al.  Distributed Robust Optimization for Communication Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[2]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[3]  Yin Xu,et al.  Microgrids for Service Restoration to Critical Load in a Resilient Distribution System , 2018, IEEE Transactions on Smart Grid.

[4]  Jun Wang,et al.  Robust Pole Assignment for Synthesizing Feedback Control Systems Using Recurrent Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Jun Wang,et al.  Tube-Based Robust Model Predictive Control of Nonlinear Systems via Collective Neurodynamic Optimization , 2016, IEEE Transactions on Industrial Electronics.

[6]  Chiara Bartolozzi,et al.  Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems , 2014, Proceedings of the IEEE.

[7]  Chongqing Kang,et al.  Decentralized Intraday Generation Scheduling for Multiarea Power Systems via Dynamic Multiplier-Based Lagrangian Relaxation , 2017, IEEE Transactions on Power Systems.

[8]  Yi Wang,et al.  Clustering of Electricity Consumption Behavior Dynamics Toward Big Data Applications , 2016, IEEE Transactions on Smart Grid.

[9]  Xinyi Le,et al.  Neurodynamics-Based Robust Pole Assignment for High-Order Descriptor Systems , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[10]  A. Ott,et al.  Experience with PJM market operation, system design, and implementation , 2003 .

[11]  Xinghuo Yu,et al.  Distributed Event-Triggered Scheme for Economic Dispatch in Smart Grids , 2016, IEEE Transactions on Industrial Informatics.

[12]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[13]  Jun Wang,et al.  A One-Layer Recurrent Neural Network for Constrained Nonsmooth Optimization , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Jun Wang,et al.  A one-layer recurrent neural network for constrained nonconvex optimization , 2015, Neural Networks.

[15]  Chongqing Kang,et al.  Decentralized Multi-Area Economic Dispatch via Dynamic Multiplier-Based Lagrangian Relaxation , 2015, IEEE Transactions on Power Systems.

[16]  P. Marcotte.  APPLICATION OF KHOBOTOVS ALGORITHM TO VARIATIONAL INEQUALITIES ANT) NETWORK EQUILIBRIUM PROBLEMS , 1991 .

[17]  Shiqian Ma,et al.  On the Global Linear Convergence of the ADMM with MultiBlock Variables , 2014, SIAM J. Optim..

[18]  Feng Liu,et al.  Distributed gradient algorithm for constrained optimization with application to load sharing in power systems , 2015, Syst. Control. Lett..

[19]  Chongqing Kang,et al.  Cloud energy storage for residential and small commercial consumers: A business case study , 2017 .

[20]  Feng Liu,et al.  Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems , 2015, Autom..

[21]  Qingshan Liu,et al.  A Second-Order Multi-Agent Network for Bound-Constrained Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[22]  Jun Wang,et al.  A deterministic annealing neural network for convex programming , 1994, Neural Networks.

[23]  Tingwen Huang,et al.  Second-Order Continuous-Time Algorithms for Economic Power Dispatch in Smart Grids , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[24]  Leon O. Chua,et al.  Neural networks for nonlinear programming , 1988 .

[25]  Xiangfeng Wang,et al.  Multi-Agent Distributed Optimization via Inexact Consensus ADMM , 2014, IEEE Transactions on Signal Processing.

[26]  Choon Yik Tang,et al.  Zero-gradient-sum algorithms for distributed convex optimization: The continuous-time case , 2011, Proceedings of the 2011 American Control Conference.

[27]  Robert Nowak,et al.  Distributed optimization in sensor networks , 2004, Third International Symposium on Information Processing in Sensor Networks, 2004. IPSN 2004.

[28]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[29]  Youshen Xia,et al.  An Extended Projection Neural Network for Constrained Optimization , 2004, Neural Computation.

[30]  Mauro Forti,et al.  Generalized neural network for nonsmooth nonlinear programming problems , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[31]  Daniel Pérez Palomar,et al.  Noncooperative and Cooperative Optimization of Distributed Energy Generation and Storage in the Demand-Side of the Smart Grid , 2013, IEEE Transactions on Signal Processing.

[32]  Sonia Martínez,et al.  Periodic and event-triggered communication for distributed continuous-time convex optimization , 2014, 2014 American Control Conference.

[33]  Xing-Bao Gao,et al.  A novel neural network for nonlinear convex programming , 2004, IEEE Trans. Neural Networks.

[34]  Long Cheng,et al.  Recurrent Neural Network for Non-Smooth Convex Optimization Problems With Application to the Identification of Genetic Regulatory Networks , 2011, IEEE Transactions on Neural Networks.

[35]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[36]  Qingshan Liu,et al.  A Collaborative Neurodynamic Approach to Multiple-Objective Distributed Optimization , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[37]  Qingshan Liu,et al.  A one-layer recurrent neural network for constrained pseudoconvex optimization and its application for dynamic portfolio optimization , 2012, Neural Networks.

[38]  Damiano Varagnolo,et al.  Newton-Raphson Consensus for Distributed Convex Optimization , 2015, IEEE Transactions on Automatic Control.

[39]  Jun Wang,et al.  A projection neural network and its application to constrained optimization problems , 2002 .

[40]  Lang Tong,et al.  Coordinated Multi-Area Economic Dispatch via Critical Region Projection , 2017, IEEE Transactions on Power Systems.

[41]  Qingshan Liu,et al.  A Multi-Agent System With a Proportional-Integral Protocol for Distributed Constrained Optimization , 2017, IEEE Transactions on Automatic Control.

[42]  Qingshan Liu,et al.  A Collective Neurodynamic Approach to Distributed Constrained Optimization , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[43]  Qingshan Liu,et al.  A One-Layer Recurrent Neural Network With a Discontinuous Hard-Limiting Activation Function for Quadratic Programming , 2008, IEEE Transactions on Neural Networks.

[44]  C. Kang,et al.  Distributed real-time demand response based on Lagrangian multiplier optimal selection approach ☆ , 2017 .

[45]  Qingshan Liu,et al.  Distributed Optimization Based on a Multiagent System in the Presence of Communication Delays , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.