Topology Design for Stochastically Forced Consensus Networks

We study an optimal control problem aimed at adding a certain number of edges to an undirected network, with a known graph Laplacian, in order to optimally enhance closed-loop performance. The performance is quantified by the steady-state variance amplification of the network with additive stochastic disturbances. To promote controller sparsity, we introduce <inline-formula><tex-math notation="LaTeX">$\ell _1$</tex-math></inline-formula>-regularization into the optimal <inline-formula><tex-math notation="LaTeX">${\mathcal H}_2$</tex-math></inline-formula> formulation and cast the design problem as a semidefinite program. We derive a Lagrange dual, provide interpretation of dual variables, and exploit structure of the optimality conditions for undirected networks to develop customized proximal gradient and Newton algorithms that are well suited for large problems. We illustrate that our algorithms can solve the problems with more than million edges in the controller graph in a few minutes, on a PC. We also exploit structure of connected resistive networks to demonstrate how additional edges can be systematically added in order to minimize the <inline-formula><tex-math notation="LaTeX">${\mathcal H}_2$</tex-math></inline-formula> norm of the closed-loop system.

[1]  Frank Allgöwer,et al.  Performance and design of cycles in consensus networks , 2013, Syst. Control. Lett..

[2]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[3]  Paul Tseng,et al.  A coordinate gradient descent method for nonsmooth separable minimization , 2008, Math. Program..

[4]  Mehran Mesbahi,et al.  Edge Agreement: Graph-Theoretic Performance Bounds and Passivity Analysis , 2011, IEEE Transactions on Automatic Control.

[5]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[6]  Kim-Chuan Toh,et al.  SDPT3 -- A Matlab Software Package for Semidefinite Programming , 1996 .

[7]  Bassam Bamieh,et al.  Coherence in Large-Scale Networks: Dimension-Dependent Limitations of Local Feedback , 2011, IEEE Transactions on Automatic Control.

[8]  Pradeep Ravikumar,et al.  QUIC: quadratic approximation for sparse inverse covariance estimation , 2014, J. Mach. Learn. Res..

[9]  Mehran Mesbahi,et al.  On maximizing the second smallest eigenvalue of a state-dependent graph Laplacian , 2006, IEEE Transactions on Automatic Control.

[10]  Chinwendu Enyioha,et al.  Optimal vaccine allocation to control epidemic outbreaks in arbitrary networks , 2013, 52nd IEEE Conference on Decision and Control.

[11]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[12]  Fu Lin,et al.  Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers , 2011, IEEE Transactions on Automatic Control.

[13]  Michael A. Saunders,et al.  Proximal Newton-Type Methods for Minimizing Composite Functions , 2012, SIAM J. Optim..

[14]  J. Hespanha,et al.  Estimation on Graphs from Relative Measurements Distributed algorithms and fundamental limits , 2022 .

[15]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[16]  Fu Lin,et al.  On the properties of optimal weak links in consensus networks , 2014, 53rd IEEE Conference on Decision and Control.

[17]  Stephen P. Boyd,et al.  Minimizing Effective Resistance of a Graph , 2008, SIAM Rev..

[18]  Milad Siami,et al.  Tractable approximation algorithms for the NP-hard problem of growing linear consensus networks , 2016, 2016 American Control Conference (ACC).

[19]  Roger Fletcher,et al.  Projected Barzilai-Borwein methods for large-scale box-constrained quadratic programming , 2005, Numerische Mathematik.

[20]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[21]  A. Saberi,et al.  Designing spatially heterogeneous strategies for control of virus spread. , 2008, IET systems biology.

[22]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[23]  M. Fardad,et al.  Sparsity-promoting optimal control for a class of distributed systems , 2011, Proceedings of the 2011 American Control Conference.

[24]  Fu Lin,et al.  Design of Optimal Sparse Interconnection Graphs for Synchronization of Oscillator Networks , 2013, IEEE Transactions on Automatic Control.

[25]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[26]  Mihailo R. Jovanovic,et al.  An interior point method for growing connected resistive networks , 2015, 2015 American Control Conference (ACC).

[27]  John Lygeros,et al.  Topology design for optimal network coherence , 2014, 2015 European Control Conference (ECC).

[28]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[29]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[30]  Fu Lin,et al.  Identification of sparse communication graphs in consensus networks , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[31]  Stephen P. Boyd,et al.  Growing Well-connected Graphs , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[32]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[33]  Stanford,et al.  Learning to Discover Social Circles in Ego Networks , 2012 .