The least-squares identification of FIR systems subject to worst-case noise

The least-squares identification of FIR systems is analyzed assuming that the noise is a bounded signal and the input signal is a pseudo-random binary sequence. A lower bound on the worst-case transfer function error shows that the least-square estimate of the transfer function diverges as the order of the FIR system is increased. This implies that, in the presence of the worst-case noise, the trade-off between the estimation error due to the disturbance and the bias error (due to unmodeled dynamics) is significantly different from the corresponding trade-off in the random error case: with a worst-case formulation, the model complexity should not increase indefinitely as the size of the data set increases.

[1]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[2]  L. Ljung,et al.  Asymptotic Properties of the Least Squares Method for Estimating Transfer Functions and Disturbance Spectra , 1992 .

[3]  Carl N. Nett,et al.  Control oriented system identification: a worst-case/deterministic approach in H/sub infinity / , 1991 .

[4]  J. Tsitsiklis,et al.  The sample complexity of worst-case identification of FIR linear systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[5]  Ian Barrodale,et al.  Algorithm 495: Solution of an Overdetermined System of Linear Equations in the Chebychev Norm [F4] , 1975, TOMS.

[6]  M. Schroeder.  Number Theory in Science and Communication , 1984 .

[7]  P. Mäkilä.  Robust identification and Galois sequences , 1991 .

[8]  Mario Milanese,et al.  Properties of Least Squares Estimates in Set Membership Identification , 1994 .

[9]  J. Tsitsiklis,et al.  The sample complexity of worst-case identification of FIR linear systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[10]  Pramod P. Khargonekar.  Identification and robust control , 1994 .

[11]  Håkan Hjalmarsson.  Aspects on Incomplete Modeling in System Identification , 1993 .

[12]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[13]  Pramod P. Khargonekar,et al.  The least squares algorithm, parametric system identification and bounded noise , 1993, Autom..

[14]  L. Ljung,et al.  Asymptotic properties of black-box identification of transfer functions , 1985 .

[15]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[16]  Jonathan R. Partington,et al.  Analysis of Linear Methods for Robust Identification in ℓ 1 , 1994 .

[17]  John N. Tsitsiklis,et al.  Optimal asymptotic identification under bounded disturbances , 1993, IEEE Trans. Autom. Control..

[18]  Jonathan R. Partington,et al.  Worst-case identification in e 2 : linear and nonlinear algorithms , 1994 .