Optimal Control of Network-Coupled Subsystems: Spectral Decomposition and Low-Dimensional Solutions

In this paper, we investigate optimal control of network-coupled subsystems where the dynamics and the cost couplings depend on an underlying undirected weighted graph. The graph coupling matrix in the dynamics may be the adjacency matrix, the Laplacian matrix, or any other symmetric matrix corresponding to the underlying graph. The cost couplings can be any polynomial function of the underlying coupling matrix. We use the spectral decomposition of the graph coupling matrix to decompose the overall system into (L+ 1) systems with decoupled dynamics and cost, where L is the rank of the coupling matrix. Furthermore, the optimal control input at each subsystem can be computed by solving (Ldist + 1) decoupled Riccati equations where Ldist (Ldist ≤ L) is the number of distinct non-zero eigenvalues of the coupling matrix. A salient feature of the result is that the solution complexity depends on the number of distinct eigenvalues of the coupling matrix rather than the size of the network. Therefore, the proposed solution framework provides a scalable method for synthesizing and implementing optimal control laws for large-scale network-coupled subsystems.

[1]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[2]  Malur K. Sundareshan,et al.  Qualitative analysis and decentralized controller synthesis for a class of large-scale systems with symmetrically interconnected subsystems , 1991, Autom..

[3]  Aditya Mahajan,et al.  Team-optimal solution of finite number of mean-field coupled LQG subsystems , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[4]  Frank L. Lewis,et al.  Cooperative Optimal Control for Multi-Agent Systems on Directed Graph Topologies , 2014, IEEE Transactions on Automatic Control.

[5]  Albert-László Barabási,et al.  Controllability of complex networks , 2011, Nature.

[6]  V. Kučera.  A contribution to matrix quadratic equations , 1972 .

[7]  Yongcan Cao,et al.  Optimal Linear-Consensus Algorithms: An LQR Perspective , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[9]  Peter E. Caines,et al.  Spectral Representations of Graphons in Very Large Network Systems Control , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[10]  J. Slotine,et al.  Spectrum of controlling and observing complex networks , 2015, Nature Physics.

[11]  Francesco Borrelli,et al.  Distributed LQR Design for Identical Dynamically Decoupled Systems , 2008, IEEE Transactions on Automatic Control.

[12]  Dragoslav D. Siljak,et al.  Control of large-scale systems: Beyond decentralized feedback , 2004, Annu. Rev. Control..

[13]  Mireille E. Broucke,et al.  Local control strategies for groups of mobile autonomous agents , 2004, IEEE Transactions on Automatic Control.

[14]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[15]  Guang-Hong Yang,et al.  Structural properties of large-scale systems possessing similar structures , 1995, Autom..

[16]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..

[17]  Michael Athans,et al.  Survey of decentralized control methods for large scale systems , 1978 .

[18]  Jr-Shin Li,et al.  Ensemble Control of Finite-Dimensional Time-Varying Linear Systems , 2008, IEEE Transactions on Automatic Control.

[19]  Mireille E. Broucke,et al.  Patterned linear systems , 2012, Autom..

[20]  S. Marcus,et al.  The structure of nonlinear control systems possessing symmetries , 1985 .

[21]  H. van de Water,et al.  The certainty equivalence property in stochastic control theory , 1981 .

[22]  Leonid Mirkin,et al.  Distributed Control with Low-Rank Coordination , 2014, IEEE Transactions on Control of Network Systems.

[23]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[24]  Aditya Mahajan,et al.  Linear Quadratic Mean Field Teams: Optimal and Approximately Optimal Decentralized Solutions , 2016 .

[25]  Guang-Hong Yang,et al.  Decentralized control of a class of large-scale systems with symmetrically interconnected subsystems , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[26]  Peter B. Luh,et al.  A hierarchical decomposition for large-scale optimal control problems with parallel processing structure , 1989, Autom..

[27]  Jan Lunze,et al.  Dynamics of strongly coupled symmetric composite systems , 1986 .

[28]  Jurgen Kurths,et al.  Synchronization in complex networks , 2008, 0805.2976.

[29]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[30]  Xun Li,et al.  Discrete time mean-field stochastic linear-quadratic optimal control problems , 2013, Autom..

[31]  Zhong-Ping Jiang,et al.  Decentralized Adaptive Optimal Control of Large-Scale Systems With Application to Power Systems , 2015, IEEE Transactions on Industrial Electronics.

[32]  Daniel Liberzon,et al.  Calculus of Variations and Optimal Control Theory: A Concise Introduction , 2012 .

[33]  M. Aoki.  Control of large-scale dynamic systems by aggregation , 1968 .

[34]  Frank L. Lewis,et al.  Cooperative Control of Multi-Agent Systems: Optimal and Adaptive Design Approaches , 2013 .

[35]  Giacomo Como,et al.  Graphical Games and Decomposition , 2020, ArXiv.

[36]  M. Kanat Camlibel,et al.  A Suboptimality Approach to Distributed Linear Quadratic Optimal Control , 2020, IEEE Transactions on Automatic Control.

[37]  Francesco Bullo,et al.  Controllability Metrics, Limitations and Algorithms for Complex Networks , 2013, IEEE Transactions on Control of Network Systems.

[38]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[39]  Qu,et al.  Controlling spatiotemporal chaos in coupled map lattice systems. , 1994, Physical review letters.

[40]  R. Murray,et al.  Consensus protocols for networks of dynamic agents , 2003, Proceedings of the 2003 American Control Conference, 2003..

[41]  P. Benner,et al.  Solving large-scale control problems , 2004, IEEE Control Systems.

[42]  Le Song,et al.  Learning Social Infectivity in Sparse Low-rank Networks Using Multi-dimensional Hawkes Processes , 2013, AISTATS.

[43]  M. Cross,et al.  Pinning control of spatiotemporal chaos , 1997, chao-dyn/9705001.

[44]  Shuang Gao,et al.  Graphon Control of Large-Scale Networks of Linear Systems , 2018, IEEE Transactions on Automatic Control.

[45]  Madeleine Udell,et al.  Why Are Big Data Matrices Approximately Low Rank? , 2017, SIAM J. Math. Data Sci..

[46]  Guanrong Chen,et al.  Pinning control of scale-free dynamical networks , 2002 .

[47]  Peter E. Caines,et al.  Optimal and Approximate Solutions to Linear Quadratic Regulation of a Class of Graphon Dynamical Systems , 2019, 2019 IEEE 58th Conference on Decision and Control (CDC).

[48]  Peter E. Caines,et al.  Social Optima in Mean Field LQG Control: Centralized and Decentralized Strategies , 2012, IEEE Transactions on Automatic Control.

[49]  Angel Garrido,et al.  Symmetry in Complex Networks , 2011, Symmetry.