Distributed resource allocation with binary decisions via Newton-like Neural Network dynamics

This paper aims to solve a distributed resource allocation problem with binary local constraints. The problem is formulated as a binary program with a cost function defined by the summation of agent costs plus a global mismatch/penalty term. We propose a modification of the Hopfield Neural Network (HNN) dynamics in order to solve this problem while incorporating a novel Newton-like weighting factor. This addition lends itself to fast avoidance of saddle points, which the gradient-like HNN is susceptible to. Turning to a multi-agent setting, we reformulate the problem and develop a distributed implementation of the Newton-like dynamics. We show that if a local solution to the distributed reformulation is obtained, it is also a local solution to the centralized problem. A main contribution of this work is to show that the probability of converging to a saddle point of an appropriately defined energy function in both the centralized and distributed settings is zero under light assumptions. Finally, we enlarge our algorithm with an annealing technique which gradually learns a feasible binary solution. Simulation results demonstrate that the proposed methods are competitive with centralized greedy and SDP relaxation approaches in terms of solution quality, while the main advantage of our approach is a significant improvement in runtime over the SDP relaxation method and the distributed quality of implementation.

[1]  Tingwen Huang,et al.  Distributed Power Management for Dynamic Economic Dispatch in the Multimicrogrids Environment , 2019, IEEE Transactions on Control Systems Technology.

[2]  Feng Liu,et al.  Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems , 2015, Autom..

[3]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[4]  B. Kamgar-Parsi Dynamical stability and parameter selection in neural optimization , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[5]  Gregory Gutin,et al.  Traveling salesman should not be greedy: domination analysis of greedy-type heuristics for the TSP , 2001, Discret. Appl. Math..

[6]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[7]  Philip E. Gill,et al.  Practical optimization , 1981 .

[8]  Xiaoling Sun,et al.  Polynomially Solvable Cases of Binary Quadratic Programs , 2010 .

[9]  P. Chardaire,et al.  A Decomposition Method for Quadratic Zero-One Programming , 1995 .

[10]  R. Sanfelice,et al.  Hybrid dynamical systems , 2009, IEEE Control Systems.

[11]  Aryan Mokhtari,et al.  A Newton-Based Method for Nonconvex Optimization with Fast Evasion of Saddle Points , 2017, SIAM J. Optim..

[12]  Victor Y. Pan,et al.  The complexity of the matrix eigenproblem , 1999, STOC '99.

[13]  Nicanor Quijano,et al.  Intra-Hour Microgrid Economic Dispatch Based on Model Predictive Control , 2020, IEEE Transactions on Smart Grid.

[14]  K. Rose Deterministic annealing for clustering, compression, classification, regression, and related optimization problems , 1998, Proc. IEEE.

[15]  S. I. Bank,et al.  Hopfield network in solving travelling salesman problem in navigation , 2002, 6th Seminar on Neural Network Applications in Electrical Engineering.

[16]  Qiuye Sun,et al.  Distributed Optimal Economic Dispatch for Microgrids Considering Communication Delays , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[17]  Enrique Mallada,et al.  The Role of Convexity in Saddle-Point Dynamics: Lyapunov Function and Robustness , 2016, IEEE Transactions on Automatic Control.

[18]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[19]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[20]  Haris Vikalo,et al.  Greedy sensor selection: Leveraging submodularity , 2010, 49th IEEE Conference on Decision and Control (CDC).

[21]  Stephen P. Boyd,et al.  Semidefinite Programming Relaxations of Non-Convex Problems in Control and Combinatorial Optimization , 1997 .

[22]  Jacek Mańdziuk,et al.  SOLVING THE TRAVELLING SALESMAN PROBLEM WITH A HOPFIELD-TYPE NEURAL NETWORK , 1996 .

[23]  B. Mityagin The Zero Set of a Real Analytic Function , 2015, Mathematical Notes.

[24]  L. F. Grisales-Norena,et al.  Economic dispatch of energy storage systems in dc microgrids employing a semidefinite programming model , 2019, Journal of Energy Storage.

[25]  Minghui Zhu,et al.  Distributed Optimization-Based Control of Multi-Agent Networks in Complex Environments , 2015 .

[26]  Junzhi Yu,et al.  Distributed Energy Management Strategy for Reaching Cost-Driven Optimal Operation Integrated With Wind Forecasting in Multimicrogrids System , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[27]  Franz Rendl,et al.  A recipe for semidefinite relaxation for (0,1)-quadratic programming , 1995, J. Glob. Optim..

[28]  Tor Anderson,et al.  Distributed approximate Newton algorithms and weight design for constrained optimization , 2018, Autom..

[29]  Chunhua Shen,et al.  Large-Scale Binary Quadratic Optimization Using Semidefinite Relaxation and Applications , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  A. Bose,et al.  Optimal Reactive Power Dispatch With Accurately Modeled Discrete Control Devices: A Successive Linear Approximation Approach , 2017 .

[31]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[32]  P. Holmes,et al.  Nonlinear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields , 1983, Applied Mathematical Sciences.

[33]  Surya Ganguli,et al.  Identifying and attacking the saddle point problem in high-dimensional non-convex optimization , 2014, NIPS.

[34]  Pablo A. Parrilo,et al.  Semidefinite Programming Relaxations and Algebraic Optimization in Control , 2003, Eur. J. Control.

[35]  John N. Tsitsiklis,et al.  Neuro-Dynamic Programming , 1996, Encyclopedia of Machine Learning.

[36]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[37]  Zhi-Quan Luo,et al.  Semidefinite Relaxation of Quadratic Optimization Problems , 2010, IEEE Signal Processing Magazine.