Distributed Computation of Linear Matrix Equations: An Optimization Perspective

This paper investigates the distributed computation of the well-known linear matrix equation in the form of <inline-formula><tex-math notation="LaTeX">${{AXB}} = F$</tex-math></inline-formula>, with the matrices <inline-formula><tex-math notation="LaTeX">$A$</tex-math></inline-formula>, <inline-formula><tex-math notation="LaTeX">$B$</tex-math></inline-formula>, <inline-formula><tex-math notation="LaTeX">$X$</tex-math></inline-formula>, and <inline-formula><tex-math notation="LaTeX">$F$</tex-math></inline-formula> of appropriate dimensions, over multiagent networks from an optimization perspective. In this paper, we consider the standard distributed matrix-information structures, where each agent of the considered multiagent network has access to one of the subblock matrices of <inline-formula><tex-math notation="LaTeX">$A$</tex-math></inline-formula>, <inline-formula><tex-math notation="LaTeX">$B$</tex-math></inline-formula>, and <inline-formula><tex-math notation="LaTeX">$F$</tex-math></inline-formula>. To be specific, we first propose different decomposition methods to reformulate the matrix equations in standard structures as distributed constrained optimization problems by introducing substitutional variables; we show that the solutions of the reformulated distributed optimization problems are equivalent to least squares solutions to original matrix equations; and we design distributed continuous-time algorithms for the constrained optimization problems, even by using augmented matrices and a derivative feedback technique. Moreover, we prove the exponential convergence of the algorithms to a least squares solution to the matrix equation for any initial condition.

[1]  Xuan Wang,et al.  A Distributed Algorithm for Least Square Solutions of Linear Equations , 2017, ArXiv.

[2]  Fengxia Zhang,et al.  Least squares solutions with special structure to the linear matrix equation AXB = C , 2011, Appl. Math. Comput..

[3]  Sonia Martínez,et al.  Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication , 2014, Autom..

[4]  Hongxing Wang,et al.  Relations between least-squares and least-rank solutions of the matrix equation AXB=CAXB=C , 2013, Appl. Math. Comput..

[5]  Alan J. Mayne,et al.  Generalized Inverse of Matrices and its Applications , 1972 .

[6]  Yiguang Hong,et al.  Distributed Continuous-Time Algorithm for Constrained Convex Optimizations via Nonsmooth Analysis Approach , 2015, IEEE Transactions on Automatic Control.

[7]  Yongge Tian Some properties of submatrices in a solution to the matrix equation AXB=C with applications , 2009, J. Frankl. Inst..

[8]  Keith G. Woodgate Least-squares solution of F = PG over positive semidefinite symmetric P , 1996 .

[9]  Jing Wang,et al.  Control approach to distributed optimization , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[10]  Yiguang Hong,et al.  Continuous-time distributed algorithms for solving linear algebraic equation , 2017, 2017 36th Chinese Control Conference (CCC).

[11]  Xi-Yan Hu,et al.  The skew-symmetric orthogonal solutions of the matrix equation AX=B☆ , 2005 .

[12]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[13]  G. Strang The Fundamental Theorem of Linear Algebra , 1993 .

[14]  Lihua Xie,et al.  Distributed constrained optimal consensus of multi-agent systems , 2016, Autom..

[15]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.

[16]  Karl Henrik Johansson,et al.  Randomized optimal consensus of multi-agent systems , 2011, Autom..

[17]  D. Bernstein Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[18]  Brian D. O. Anderson,et al.  Network Flows That Solve Linear Equations , 2015, IEEE Transactions on Automatic Control.

[19]  Xi-Yan Hu,et al.  An iteration method for the symmetric solutions and the optimal approximation solution of the matrix equation AXB=C , 2005, Appl. Math. Comput..

[20]  Feng Liu,et al.  Distributed gradient algorithm for constrained optimization with application to load sharing in power systems , 2015, Syst. Control. Lett..

[21]  Brian D. O. Anderson,et al.  Distributed network flows solving linear algebraic equations , 2016, 2016 American Control Conference (ACC).

[22]  A. Ruszczynski,et al.  Nonlinear Optimization , 2006 .

[23]  Feng Ding,et al.  Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle , 2008, Appl. Math. Comput..

[24]  Shaoshuai Mou,et al.  A distributed algorithm for solving a linear algebraic equation , 2015, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[25]  Lili Wang,et al.  A distributed algorithm with an arbitrary initialization for solving a linear algebraic equation , 2016, 2016 American Control Conference (ACC).

[26]  Zhen-yun Peng,et al.  An iterative method for the least squares symmetric solution of matrix equation $AXB = C$ , 2006, Numerical Algorithms.

[27]  Qingshan Liu,et al.  A Second-Order Multi-Agent Network for Bound-Constrained Distributed Optimization , 2015, IEEE Transactions on Automatic Control.

[28]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .

[29]  K. S. Banerjee Generalized Inverse of Matrices and Its Applications , 1973 .

[30]  Ji Liu,et al.  Exponential convergence of a distributed algorithm for solving linear algebraic equations , 2017, Autom..

[31]  D. Bernstein Matrix Mathematics: Theory, Facts, and Formulas , 2009 .

[32]  Feng Liu,et al.  Initialization-free distributed algorithms for optimal resource allocation with feasibility constraints and application to economic dispatch of power systems , 2015, Autom..

[33]  W. Haddad,et al.  Nonlinear Dynamical Systems and Control: A Lyapunov-Based Approach , 2008 .

[34]  Sanjay P. Bhat,et al.  Semistability, Finite-Time Stability, Differential Inclusions, and Discontinuous Dynamical Systems Having a Continuum of Equilibria , 2009, IEEE Transactions on Automatic Control.

[35]  Lei Wu,et al.  The Re-positive definite solutions to the matrix inverse problem AX=B , 1992 .

[36]  S. Mitra The Matrix Equation $AXB + CXD = E$ , 1977 .

[37]  J. K. Baksalary,et al.  The matrix equation AXB+CYD=E , 1980 .

[38]  Yang Liu,et al.  An Arrow-Hurwicz-Uzawa Type Flow as Least Squares Solver for Network Linear Equations , 2017, Autom..

[39]  Shaoshuai Mou,et al.  Asynchronous Distributed Algorithms for Solving Linear Algebraic Equations , 2018, IEEE Transactions on Automatic Control.

[40]  Bahman Gharesifard,et al.  Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs , 2012, IEEE Transactions on Automatic Control.

[41]  Shengyuan Xu,et al.  Regularized Primal–Dual Subgradient Method for Distributed Constrained Optimization , 2016, IEEE Transactions on Cybernetics.

[42]  Shaoshuai Mou,et al.  Decentralized gradient algorithm for solution of a linear equation , 2015, ArXiv.