Estimated Transfer Functions with Application to Model Order Selection

Previous results on estimating errors or error bounds on identified transfer functions have relied upon prior assumptions about the noise and the unmodeled dynamics. This prior information took the form of parameterized bounding functions or parameterized probability density functions, in the time or frequency domain with known parameters. Here we show that the parameters that quantify this prior information can themselves be estimated from the data using a maximum likelihood technique. This significantly reduces the prior infor- mation required to estimate transfer function error bounds. We illustrate the usefulness of the method with a number of simula- tion examples. The paper concludes by showing how the obtained error bounds can be used for intelligent model order selection that takes into account both measurement noise and under-model- ing. Another simulation study compares our method to Akaike's well-known FPE and AIC criteria.

[1]  Håkan Hjalmarsson On Estimation of Model Quality in System Identification , 1990 .

[2]  D. Catlin Estimation, Control, and the Discrete Kalman Filter , 1988 .

[3]  G. Goodwin,et al.  A stochastic embedding approach for quantifying uncertainty in the estimation of restricted complexity models , 1989 .

[4]  Graham C. Goodwin,et al.  UNCERTAINTY, INFORMATION AND ESTIMATION , 1990 .

[5]  Y. F. Huang,et al.  On the value of information in system identification - Bounded noise case , 1982, Autom..

[6]  L. Ljung,et al.  Hard frequency-domain model error bounds from least-squares like identification techniques , 1992 .

[7]  Graham C. Goodwin,et al.  Bias and Variance Distribution in Transfer Function Estimation , 1991 .

[8]  C. E. Rohrs,et al.  Identification with nonparametric uncertainty , 1992 .

[9]  Er-Wei Bai,et al.  Adaptive quantification of model uncertainties by rational approximation , 1990, 29th IEEE Conference on Decision and Control.

[10]  L. Ljung Asymptotic variance expressions for identified black-box transfer function models , 1984 .

[11]  Graham C. Goodwin,et al.  Quantification of Uncertainty in Estimation , 1990, 1990 American Control Conference.

[12]  Pertti M. Mäkilä,et al.  Approximation of stable systems by laguerre filters , 1990, Autom..

[13]  Er-Wei Bai,et al.  Adaptive quantification of model uncertainties by rational approximation , 1991 .

[14]  L. Ljung Asymptotic variance expressions for identified black-box transfer function models , 1984, The 23rd IEEE Conference on Decision and Control.

[15]  J. Norton Identification of parameter bounds for ARMAX models from records with bounded noise , 1987 .

[16]  E. Fogel System identification via membership set constraints with energy constrained noise , 1979 .

[17]  L. Ljung,et al.  Design variables for bias distribution in transfer function estimation , 1986, The 23rd IEEE Conference on Decision and Control.

[18]  Michael Athans,et al.  A Frequency-Domain Estimator for Use in Adaptive Control Systems , 1987, 1987 American Control Conference.

[19]  Stephen P. Boyd,et al.  Identification of Systems with Parametric and Nonparametric Uncertainty , 1990, 1990 American Control Conference.

[20]  R. Kosut Adaptive Robust Control via Transfer Function Uncertainty Estimation , 1988, 1988 American Control Conference.

[21]  Philip Parker,et al.  Frequency domain descriptions of linear systems , 1988 .

[22]  Michel Gevers,et al.  Connecting Identification and Robust Control: A New Challenge , 1992 .

[23]  R. Kosut Adaptive control via parameter set estimation , 1988 .

[24]  R. Younce,et al.  Identification with non-parametric uncertainty , 1990, IEEE International Symposium on Circuits and Systems.

[25]  G. Dumont,et al.  Deterministic adaptive control based on Laguerre series representation , 1988 .

[26]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[27]  Pertti M. Mäkilä,et al.  Laguerre series approximation of infinite dimensional systems , 1990, Autom..

[28]  L. Valavani,et al.  A Frequency-Domain Estimator for Use in Adaptive Control Systems , 1987 .

[29]  Graham C. Goodwin,et al.  Model Error Quantification for Robust Control based on Quasi-Bayesian Estimation in Closed Loop , 1991, 1991 American Control Conference.

[30]  Robert Bitmead,et al.  Adaptive frequency response identification , 1987, 26th IEEE Conference on Decision and Control.

[31]  Graham C. Goodwin,et al.  Quantification of Uncertainty in Estimation using an Embedding Principle , 1989, 1989 American Control Conference.

[32]  B. Wahlberg System identification using Laguerre models , 1991 .