Convex Structured Controller Design in Finite Horizon

We consider the problem of synthesizing optimal linear feedback policies subject to arbitrary convex constraints on the feedback matrix. This is known to be a hard problem in the usual formulations (H2, H∞, LQR) and previous works have focused on characterizing classes of structural constraints that allow an efficient solution through convex optimization or dynamic programming techniques. In this paper, we propose a new control objective for finite horizon discrete-time problems and show that this formulation makes the problem of computing optimal linear feedback matrices convex under arbitrary convex constraints on the feedback matrix. This allows us to solve problems in decentralized control (sparsity in the feedback matrices), control with delays, and variable impedance control. Although the control objective is nonstandard, we present theoretical and empirical evidence showing that it agrees well with standard notions of control. We show that the theoretical approach carries over to nonlinear systems, although the computational tractability of the extension is not investigated in this paper. We present numerical experiments validating our approach.

[1]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[2]  J. Speyer,et al.  Centralized and decentralized solutions of the linear-exponential-Gaussian problem , 1994, IEEE Trans. Autom. Control..

[3]  A. Lewis The Convex Analysis of Unitarily Invariant Matrix Functions , 1995 .

[4]  J. Tsitsiklis,et al.  NP-hardness of some linear control design problems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[5]  T. Basar,et al.  H∞-0ptimal Control and Related Minimax Design Problems: A Dynamic Game Approach , 1996, IEEE Trans. Autom. Control..

[6]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[7]  Guisheng Zhai,et al.  Decentralized Hinfinity controller design: a matrix inequality approach using a homotopy method , 1998, Autom..

[8]  Pablo A. Iglesias,et al.  Tradeoffs in linear time-varying systems: an analogue of Bode's sensitivity integral , 2001, Autom..

[9]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[10]  S. Lall,et al.  Decentralized control information structures preserved under feedback , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[11]  Murti V. Salapaka,et al.  Structured optimal and robust control with multiple criteria: a convex solution , 2004, IEEE Transactions on Automatic Control.

[12]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[13]  Adrian S. Lewis,et al.  HIFOO - A MATLAB package for fixed-order controller design and H ∞ optimization , 2006 .

[14]  Pierre Apkarian,et al.  Mixed H2/Hinfinity Control via Nonsmooth Optimization , 2008, SIAM J. Control. Optim..

[15]  Pablo A. Parrilo,et al.  ℋ2-optimal decentralized control over posets: A state space solution for state-feedback , 2010, 49th IEEE Conference on Decision and Control (CDC).

[16]  S. Lall,et al.  An Explicit Dynamic Programming Solution for a De centralized Two-Player Optimal Linear-Quadratic Regulator , 2010 .

[17]  Joachim Dahl,et al.  Implementation of nonsymmetric interior-point methods for linear optimization over sparse matrix cones , 2010, Math. Program. Comput..

[18]  R. A. Becker,et al.  The Variance Drain and Jensen's Inequality , 2012 .

[19]  Emanuel Todorov,et al.  Convex control design via covariance minimization , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[20]  Carsten W. Scherer,et al.  Structured $H_\infty$-Optimal Control for Nested Interconnections: A State-Space Solution , 2013, 1305.1746.

[21]  A. Lewis,et al.  Nonsmooth optimization via quasi-Newton methods , 2012, Mathematical programming.

[22]  Javad Lavaei,et al.  Optimal decentralized control problem as a rank-constrained optimization , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  Carsten W. Scherer,et al.  Structured H∞-optimal control for nested interconnections: A state-space solution , 2013, Syst. Control. Lett..

[24]  Pablo A. Parrilo,et al.  $ {\cal H}_{2}$-Optimal Decentralized Control Over Posets: A State-Space Solution for State-Feedback , 2010, IEEE Transactions on Automatic Control.

[25]  Fu Lin,et al.  Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers , 2011, IEEE Transactions on Automatic Control.

[26]  José M. F. Moura,et al.  Eigendecomposition of Block Tridiagonal Matrices , 2013, 1306.0217.

[27]  Laurent Lessard,et al.  Optimal decentralized state-feedback control with sparsity and delays , 2013, Autom..