Guaranteed characterization of exact confidence regions for FIR models under mild assumptions on the noise via interval analysis

SPS is one of the two methods proposed recently by Campi et al. to obtain exact, non-asymptotic confidence regions for parameter estimates under mild assumptions on the noise distribution. It does not require the measurement noise to be Gaussian (or to have any other known distribution for that matter). The numerical characterization of the resulting confidence regions is far from trivial, however, and has only be carried out so far on very low-dimensional problems via methods that could not guarantee their results and could not be extended to large-scale problems because of their intrinsic complexity. The aim of the present paper is to show how interval analysis can contribute to a guaranteed characterization of exact confidence regions in large-scale problems. The application considered is the estimation of the parameters of finite-impulse-response (FIR) models. The structure of the problem makes it possible to define a very efficient specific contractor, allowing the treatement of models with a large number of parameters, as is the rule for FIR models, and thus escaping the curse of dimensionality that often plagues interval methods.

[1]  Andrej Pázman,et al.  Densities of Nonlinear Functions of the Nonlinear Least-Squares Estimator , 1994 .

[2]  Luc Jaulin,et al.  Applied Interval Analysis , 2001, Springer London.

[3]  Eric Walter,et al.  Set inversion via interval analysis for nonlinear bounded-error estimation , 1993, Autom..

[4]  Luc Jaulin,et al.  Robust set-membership state estimation; application to underwater robotics , 2009, Autom..

[5]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[6]  Eric Walter,et al.  Guaranteed robust nonlinear minimax estimation , 2002, IEEE Trans. Autom. Control..

[7]  Oleg Granichin The nonasymptotic confidence set for parameters of a linear control object under an arbitrary external disturbance , 2012 .

[8]  Erik Weyer,et al.  Non-Asymptotic Confidence Sets for the Parameters of Linear Transfer Functions , 2010, IEEE Transactions on Automatic Control.

[9]  Erik Weyer,et al.  Parameter identification for nonlinear systems: Guaranteed confidence regions through LSCR , 2007, Autom..

[10]  Eric Walter,et al.  Identification of Parametric Models: from Experimental Data , 1997 .

[11]  Andeej Pizman,et al.  Invited discussion paper small-sample distributional properties of nonlinear regression estimators (a geometric approach) , 1990 .

[12]  J. Norton,et al.  Bounding Approaches to System Identification , 1996 .

[13]  Balázs Csanád Csáji,et al.  Non-Asymptotic Confidence Regions for the Least-Squares Estimate , 2012 .

[14]  Eric Walter,et al.  Guaranteed Characterization of Exact Non-Asymptotic Confidence Regions in Nonlinear Parameter Estimation , 2013, NOLCOS.

[15]  Philip Hougaard Saddlepoint approximations for curved exponential families , 1985 .

[16]  Luc Jaulin Set-membership localization with probabilistic errors , 2011, Robotics Auton. Syst..

[17]  Erik Weyer,et al.  Guaranteed non-asymptotic confidence regions in system identification , 2005, Autom..

[18]  M. Large Deviation Approximations for Maximum Likelihood Estimators Preprint July 1 81 9 , .