Minimax Lower Bounds for $\mathcal{H}_\infty$-Norm Estimation

The problem of estimating the $\mathcal{H}_\infty$-norm of an LTI system from noisy input/output measurements has attracted recent attention as an alternative to parameter identification for bounding unmodeled dynamics in robust control. In this paper, we study lower bounds for $\mathcal{H}_\infty$-norm estimation under a query model where at each iteration the algorithm chooses a bounded input signal and receives the response of the chosen signal corrupted by white noise. We prove that when the underlying system is an FIR filter, $\mathcal{H}_\infty$-norm estimation is no more efficient than model identification for passive sampling. For active sampling, we show that norm estimation is at most a factor of $\log{r}$ more sample efficient than model identification, where $r$ is the length of the filter. We complement our theoretical results with experiments which demonstrate that a simple non-adaptive estimator of the norm is competitive with state-of-the-art adaptive norm estimation algorithms.

[1]  Benjamin Recht,et al.  Non-Asymptotic Analysis of Robust Control from Coarse-Grained Identification , 2017, ArXiv.

[2]  Alexandre Proutière,et al.  A stochastic multi-armed bandit approach to nonparametric H∞-norm estimation , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[3]  Jean-Yves Audibert,et al.  Minimax Policies for Adversarial and Stochastic Bandits. , 2009, COLT 2009.

[4]  Håkan Hjalmarsson,et al.  Iterative Data-Driven ${\cal H}_{\infty}$ Norm Estimation of Multivariable Systems With Application to Robust Active Vibration Isolation , 2014, IEEE Transactions on Control Systems Technology.

[5]  Dominique Bonvin,et al.  Data-driven estimation of the infinity norm of a dynamical system , 2007, 2007 46th IEEE Conference on Decision and Control.

[6]  Jorge J. Moré,et al.  Benchmarking optimization software with performance profiles , 2001, Math. Program..

[7]  S. M. Joshi,et al.  Some properties and stability results for sector-bounded LTI systems , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[8]  Alexander Goldenshluger,et al.  Nonparametric Estimation of Transfer Functions: Rates of Convergence and Adaptation , 1998, IEEE Trans. Inf. Theory.

[9]  Clas A. Jacobson Control Oriented System Identification , 1993 .

[10]  Sergio M. Savaresi,et al.  Data-driven H∞-norm estimation via expert advice , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[11]  Bo Wahlberg,et al.  Analyzing iterations in identification with application to nonparametric H∞-norm estimation , 2012, Autom..

[12]  Ion Stoica,et al.  Occupy the cloud: distributed computing for the 99% , 2017, SoCC.

[13]  Sébastien Bubeck,et al.  Regret Analysis of Stochastic and Nonstochastic Multi-armed Bandit Problems , 2012, Found. Trends Mach. Learn..

[14]  Alexandre B. Tsybakov,et al.  Introduction to Nonparametric Estimation , 2008, Springer series in statistics.

[15]  Bo Wahlberg,et al.  Non-parametric methods for L2-gain estimation using iterative experiments , 2010, Autom..

[16]  A. Böttcher,et al.  Toeplitz Matrices, Asymptotic Linear Algebra, and Functional Analysis , 2000 .

[17]  Stephen Tu,et al.  On the Approximation of Toeplitz Operators for Nonparametric $\mathcal{H}_{\infty}$-norm Estimation , 2017, American Control Conference.

[18]  Roman Vershynin,et al.  High-Dimensional Probability , 2018 .