Optimal decentralized control problem as a rank-constrained optimization

This paper is concerned with the long-standing optimal decentralized control (ODC) problem. The objective is to design a fixed-order decentralized controller for a discrete-time system to minimize a given finite-time cost function subject to norm constraints on the input and output of the system. We cast this NP-hard problem as a quadratically-constrained quadratic program, and then reformulate it as a rank-constrained optimization. The reformulated problem is a semidefinite program (SDP) after removing its rank-1 constraint. Whenever the SDP relaxation has a rank-1 solution, a globally optimal decentralized controller can be recovered from this solution. This paper studies the rank of the minimum-rank solution of the SDP relaxation since this number may provide rich information about the level of the approximation needed to make the ODC problem tractable. Using our recently developed notion of “nonlinear optimization over graph”, we propose a methodology to compute the rank of the minimum-rank solution of the SDP relaxation. In particular, we show that in the case where the unknown decentralized controller being sought needs to be static with a diagonal matrix gain, this rank is upper bounded by 4. Since the upper bound is close to 1 and does not depend on the order of the system, the ODC problem may not be as hard as it is thought to be. This paper also proposes a penalized SDP relaxation to heuristically enforce the few unwanted nonzero eigenvalues of the solution to diminish.

[1]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[2]  John N. Tsitsiklis,et al.  On the complexity of decentralized decision making and detection problems , 1985 .

[3]  Joe H. Chow,et al.  A parametrization approach to optimal H∞ and H2 decentralized control problems , 1993, 1992 American Control Conference.

[4]  Pedro Luis Dias Peres,et al.  Decentralized control through parameter space optimization , 1994, Autom..

[5]  Alexander I. Barvinok,et al.  Problems of distance geometry and convex properties of quadratic maps , 1995, Discret. Comput. Geom..

[6]  David P. Williamson,et al.  Improved approximation algorithms for maximum cut and satisfiability problems using semidefinite programming , 1995, JACM.

[7]  Dragoslav D. Šiljak,et al.  Decentralized control and computations: status and prospects , 1996 .

[8]  Stephen P. Boyd,et al.  Semidefinite Programming , 1996, SIAM Rev..

[9]  Y. Nesterov Semidefinite relaxation and nonconvex quadratic optimization , 1998 .

[10]  G. Zhai,et al.  Decentralized H∞ Controller Design: A Matrix Inequality Approach Using a Homotopy Method , 1998 .

[11]  Gábor Pataki,et al.  On the Rank of Extreme Matrices in Semidefinite Programs and the Multiplicity of Optimal Eigenvalues , 1998, Math. Oper. Res..

[12]  Yinyu Ye,et al.  Approximating quadratic programming with bound and quadratic constraints , 1999, Math. Program..

[13]  Guisheng Zhai,et al.  Decentralized Hinfinity controller design: a matrix inequality approach using a homotopy method , 1998, Autom..

[14]  G. Scorletti,et al.  An LMI approach to dencentralized H8 control , 2001 .

[15]  David P. Williamson,et al.  Approximation algorithms for MAX-3-CUT and other problems via complex semidefinite programming , 2001, STOC '01.

[16]  Fernando Paganini,et al.  Convex synthesis of localized controllers for spatially invariant systems , 2002, Autom..

[17]  Fernando Paganini,et al.  Distributed control of spatially invariant systems , 2002, IEEE Trans. Autom. Control..

[18]  Shuzhong Zhang,et al.  On Cones of Nonnegative Quadratic Functions , 2003, Math. Oper. Res..

[19]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[20]  Cédric Langbort,et al.  Distributed control design for systems interconnected over an arbitrary graph , 2004, IEEE Transactions on Automatic Control.

[21]  Stephen P. Boyd,et al.  Rank minimization and applications in system theory , 2004, Proceedings of the 2004 American Control Conference.

[22]  Murti V. Salapaka,et al.  Structured optimal and robust control with multiple criteria: a convex solution , 2004, IEEE Transactions on Automatic Control.

[23]  Geir E. Dullerud,et al.  Distributed control of heterogeneous systems , 2004, IEEE Transactions on Automatic Control.

[24]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[25]  Petros G. Voulgaris,et al.  A convex characterization of distributed control problems in spatially invariant systems with communication constraints , 2005, Syst. Control. Lett..

[26]  Francesco Borrelli,et al.  Decentralized receding horizon control for large scale dynamically decoupled systems , 2009, Autom..

[27]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[28]  Nader Motee,et al.  Optimal Control of Spatially Distributed Systems , 2008, 2007 American Control Conference.

[29]  Paul Tseng,et al.  Approximation Bounds for Quadratic Optimization with Homogeneous Quadratic Constraints , 2007, SIAM J. Optim..

[30]  Wendy Wang,et al.  On the Minimum Rank Among Positive Semidefinite Matrices with a Given Graph , 2008, SIAM J. Matrix Anal. Appl..

[31]  Francesco Borrelli,et al.  Distributed LQR Design for Identical Dynamically Decoupled Systems , 2008, IEEE Transactions on Automatic Control.

[32]  A. Jadbabaie,et al.  Optimal Control of Spatially Distributed Systems , 2008, IEEE Transactions on Automatic Control.

[33]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[34]  Fu Lin,et al.  On the optimal design of structured feedback gains for interconnected systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[35]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[36]  Pablo A. Parrilo,et al.  ℋ2-optimal decentralized control over posets: A state space solution for state-feedback , 2010, 49th IEEE Conference on Decision and Control (CDC).

[37]  Shuzhong Zhang,et al.  Approximation algorithms for homogeneous polynomial optimization with quadratic constraints , 2010, Math. Program..

[38]  Fu Lin,et al.  Augmented Lagrangian Approach to Design of Structured Optimal State Feedback Gains , 2011, IEEE Transactions on Automatic Control.

[39]  Weiyu Xu,et al.  Null space conditions and thresholds for rank minimization , 2011, Math. Program..

[40]  Takashi Tanaka,et al.  The Bounded Real Lemma for Internally Positive Systems and H-Infinity Structured Static State Feedback , 2011, IEEE Transactions on Automatic Control.

[41]  Anders Rantzer,et al.  Distributed control of positive systems , 2011, IEEE Conference on Decision and Control and European Control Conference.

[42]  Nuno C. Martins,et al.  On the Nearest Quadratically Invariant Information Constraint , 2011, IEEE Transactions on Automatic Control.

[43]  Javad Lavaei,et al.  Decentralized Implementation of Centralized Controllers for Interconnected Systems , 2012, IEEE Transactions on Automatic Control.

[44]  Sanjay Lall,et al.  Optimal controller synthesis for the decentralized two-player problem with output feedback , 2012, 2012 American Control Conference (ACC).

[45]  S. Low,et al.  Zero Duality Gap in Optimal Power Flow Problem , 2012, IEEE Transactions on Power Systems.

[46]  J. Lavaei,et al.  Physics of power networks makes hard optimization problems easy to solve , 2012, 2012 IEEE Power and Energy Society General Meeting.

[47]  John Doyle,et al.  Output feedback ℌ2 model matching for decentralized systems with delays , 2012, 2013 American Control Conference.

[48]  Javad Lavaei,et al.  On the exactness of semidefinite relaxation for nonlinear optimization over graphs: Part I , 2013, 52nd IEEE Conference on Decision and Control.

[49]  Javad Lavaei,et al.  On the exactness of semidefinite relaxation for nonlinear optimization over graphs: Part II , 2013, 52nd IEEE Conference on Decision and Control.

[50]  J. Lavaei,et al.  Convex relaxation for optimal power flow problem: Mesh networks , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.