Regularized estimation of sums of exponentials in spaces generated by stable spline kernels

A new nonparametric paradigm to model identification has been recently introduced in the literature. Instead of adopting finite-dimensional models of the system transfer function, the system impulse response is searched for within an infinite dimensional space using regularization theory. The method exploits the so called stable spline kernels which are associated with hypothesis spaces embedding information on both regularity and stability of the impulse response. In this paper, the potentiality of this approach is studied with respect to the reconstruction of sums of exponentials. In particular, first, we characterize the learning rates of our estimator in reconstructing such class of functions also exploiting recent advances in statistical learning theory. Then, we use Monte Carlo studies to illustrate the definite advantages of this new nonparametric approach over classical parametric prediction error methods in terms of accuracy in impulse responses reconstruction.

[1]  S. Smale,et al.  Learning Theory Estimates via Integral Operators and Their Approximations , 2007 .

[2]  H. Akaike A new look at the statistical model identification , 1974 .

[3]  M. Bertero Linear Inverse and III-Posed Problems , 1989 .

[4]  Giuseppe De Nicolao,et al.  A new kernel-based approach for linear system identification , 2010, Autom..

[5]  Alessandro Chiuso,et al.  Predictor estimation via Gaussian regression , 2008, 2008 47th IEEE Conference on Decision and Control.

[6]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[7]  Giuseppe De Nicolao,et al.  A new kernel-based approach for system identification , 2008, 2008 American Control Conference.

[8]  Graham C. Goodwin,et al.  Non-stationary stochastic embedding for transfer function estimation , 1999, Autom..

[9]  G. Kitagawa,et al.  A Smoothness Priors–State Space Modeling of Time Series with Trend and Seasonality , 1984 .

[10]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[11]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[12]  G. Pillonetto,et al.  Estimating parameters and stochastic functions of one variable using nonlinear measurement models , 2004 .

[13]  Clifford M. Hurvich,et al.  Regression and time series model selection in small samples , 1989 .

[14]  N. Aronszajn Theory of Reproducing Kernels. , 1950 .

[15]  Antonio Vicino,et al.  Optimal estimation theory for dynamic systems with set membership uncertainty: An overview , 1991, Autom..

[16]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[17]  Robert B. Litterman,et al.  Forecasting and Conditional Projection Using Realistic Prior Distributions , 1983 .

[18]  A. N. Tikhonov,et al.  Solutions of ill-posed problems , 1977 .

[19]  D. Barry Nonparametric Bayesian Regression , 1986 .

[20]  Gianluigi Pillonetto,et al.  Bayes and empirical Bayes semi-blind deconvolution using eigenfunctions of a prior covariance , 2007, Autom..

[21]  Yiming Ying,et al.  Learning Rates of Least-Square Regularized Regression , 2006, Found. Comput. Math..