Convex control design via covariance minimization

We consider the problem of synthesizing optimal linear feedback policies subject to arbitrary convex constraints on the feedback matrix. This is known to be a hard problem in the usual formulations (ℋ2;ℋ∞;LQR) and previous works have focussed on characterizing classes of structural constraints that allow efficient solution through convex optimization or dynamic programming techniques. In this paper, we propose a new control objective based on eigenvalues of the covariance matrix of trajectories of the system and show that this formulation makes the problem of computing optimal linear feedback matrices convex under arbitrary convex constraints on the feedback matrix. This allows us to solve problems in distributed control (sparsity in the feedback matrices), control with delays and variable impedance control. Although the control objective is nonstandard, we present theoretical and empirical evidence that it agrees well with standard notions of control. We numerically validate the our approach on problems arising in power systems and simple mechanical systems.

[1]  Vicenç Gómez,et al.  Optimal control as a graphical model inference problem , 2009, Machine Learning.

[2]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[3]  Pablo A. Parrilo,et al.  ℋ2-optimal decentralized control over posets: A state space solution for state-feedback , 2010, 49th IEEE Conference on Decision and Control (CDC).

[4]  Carsten W. Scherer,et al.  Structured H∞-optimal control for nested interconnections: A state-space solution , 2013, Syst. Control. Lett..

[5]  Laurent Lessard,et al.  Optimal decentralized state-feedback control with sparsity and delays , 2013, Autom..

[6]  J. Tsitsiklis,et al.  NP-hardness of some linear control design problems , 1995, Proceedings of 1995 34th IEEE Conference on Decision and Control.

[7]  R D Zimmerman,et al.  MATPOWER: Steady-State Operations, Planning, and Analysis Tools for Power Systems Research and Education , 2011, IEEE Transactions on Power Systems.

[8]  Emanuel Todorov,et al.  Efficient computation of optimal actions , 2009, Proceedings of the National Academy of Sciences.

[9]  Pierre Apkarian,et al.  Mixed H2/Hinfinity Control via Nonsmooth Optimization , 2008, SIAM J. Control. Optim..

[10]  Joachim Dahl,et al.  Implementation of nonsymmetric interior-point methods for linear optimization over sparse matrix cones , 2010, Math. Program. Comput..

[11]  Adrian S. Lewis,et al.  HIFOO - A MATLAB package for fixed-order controller design and H ∞ optimization , 2006 .

[12]  Florian Dörfler,et al.  Synchronization and transient stability in power networks and non-uniform Kuramoto oscillators , 2009, Proceedings of the 2010 American Control Conference.

[13]  Pierre Apkarian,et al.  Mixed H2/H∞ control via nonsmooth optimization , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[14]  J. Speyer,et al.  Centralized and decentralized solutions of the linear-exponential-Gaussian problem , 1994, IEEE Trans. Autom. Control..

[15]  S. Lall,et al.  An Explicit Dynamic Programming Solution for a De centralized Two-Player Optimal Linear-Quadratic Regulator , 2010 .

[16]  Carsten W. Scherer,et al.  Structured $H_\infty$-Optimal Control for Nested Interconnections: A State-Space Solution , 2013, 1305.1746.

[17]  Pablo A. Parrilo,et al.  $ {\cal H}_{2}$-Optimal Decentralized Control Over Posets: A State-Space Solution for State-Feedback , 2010, IEEE Transactions on Automatic Control.

[18]  S. Lall,et al.  Decentralized control information structures preserved under feedback , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[19]  Murti V. Salapaka,et al.  Structured optimal and robust control with multiple criteria: a convex solution , 2004, IEEE Transactions on Automatic Control.

[20]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[21]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[22]  A.R. Bergen,et al.  A Structure Preserving Model for Power System Stability Analysis , 1981, IEEE Transactions on Power Apparatus and Systems.

[23]  Arkadi Nemirovski,et al.  Lectures on modern convex optimization - analysis, algorithms, and engineering applications , 2001, MPS-SIAM series on optimization.

[24]  Fu Lin,et al.  Design of Optimal Sparse Feedback Gains via the Alternating Direction Method of Multipliers , 2011, IEEE Transactions on Automatic Control.

[25]  Pablo A. Iglesias,et al.  Tradeoffs in linear time-varying systems: an analogue of Bode's sensitivity integral , 2001, Autom..