Non-Asymptotic Analysis of Robust Control from Coarse-Grained Identification

This work explores the trade-off between the number of samples required to accurately build models of dynamical systems and the degradation of performance in various control objectives due to a coarse approximation. In particular, we show that simple models can be easily fit from input/output data and are sufficient for achieving various control objectives. We derive bounds on the number of noisy input/output samples from a stable linear time-invariant system that are sufficient to guarantee that the corresponding finite impulse response approximation is close to the true system in the $\mathcal{H}_\infty$-norm. We demonstrate that these demands are lower than those derived in prior art which aimed to accurately identify dynamical models. We also explore how different physical input constraints, such as power constraints, affect the sample complexity. Finally, we show how our analysis fits within the established framework of robust control, by demonstrating how a controller designed for an approximate system provably meets performance objectives on the true system.

[1]  R. Salem,et al.  Some properties of trigonometric series whose terms have random signs , 1954 .

[2]  R. Shibata Asymptotically Efficient Selection of the Order of the Model for Estimating Parameters of a Linear Process , 1980 .

[3]  L. Ljung,et al.  Asymptotic properties of black-box identification of transfer functions , 1985 .

[4]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[5]  Carl N. Nett,et al.  Control oriented system identification: a worst-case/deterministic approach in H/sub infinity / , 1991 .

[6]  L. Ljung,et al.  Asymptotic properties of the least-squares method for estimating transfer functions and disturbance spectra , 1992, Advances in Applied Probability.

[7]  Andrew Packard,et al.  The complex structured singular value , 1993, Autom..

[8]  Michael Jackson,et al.  Optimal Design of Experiments , 1994 .

[9]  Jie Chen,et al.  The Caratheodory-Fejer problem and H∞/l1 identification: a time domain approach , 1995, IEEE Trans. Autom. Control..

[10]  Alexander Goldenshluger,et al.  Nonparametric Estimation of Transfer Functions: Rates of Convergence and Adaptation , 1998, IEEE Trans. Inf. Theory.

[11]  A. Zeevi,et al.  NONASYMPTOTIC BOUNDS FOR AUTOREGRESSIVE TIME SERIES MODELING , 2001 .

[12]  B. Pasik-Duncan Control-oriented system identification: An H∞ approach , 2002 .

[13]  Stephen P. Boyd,et al.  Computing optimal uncertainty models from frequency domain data , 2002, Proceedings of the 41st IEEE Conference on Decision and Control, 2002..

[14]  Erik Weyer,et al.  Finite sample properties of system identification methods , 2002, IEEE Trans. Autom. Control..

[15]  R. Horn,et al.  Basic Properties of the Schur Complement , 2005 .

[16]  M. Meckes On the spectral norm of a random Toeplitz matrix , 2007, math/0703134.

[17]  Mathukumalli Vidyasagar,et al.  A learning theory approach to system identification and stochastic adaptive control , 2008 .

[18]  Bo Wahlberg,et al.  Non-parametric methods for L2-gain estimation using iterative experiments , 2010, Autom..

[19]  Gongguo Tang,et al.  Atomic Norm Denoising With Applications to Line Spectral Estimation , 2012, IEEE Transactions on Signal Processing.

[20]  Parikshit Shah,et al.  Linear system identification via atomic norm regularization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[21]  Bo Wahlberg,et al.  Analyzing iterations in identification with application to nonparametric H∞-norm estimation , 2012, Autom..

[22]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[23]  Susanne Hertz,et al.  An Introduction To Hankel Operators , 2016 .

[24]  Cosma Rohilla Shalizi,et al.  Nonparametric Risk Bounds for Time-Series Forecasting , 2012, J. Mach. Learn. Res..

[25]  Benjamin Recht,et al.  Exponential Stability Analysis via Integral Quadratic Constraints , 2017, ArXiv.

[26]  Tengyu Ma,et al.  Gradient Descent Learns Linear Dynamical Systems , 2016, J. Mach. Learn. Res..