Algorithms for Subspace State-Space System Identification: An Overview

We give a general overview of the state of the art in subspace system identification methods. We have restricted ourselves to the most important ideas and developments since the methods appeared in the late eighties. First the basics of linear subspace identification are summarized. Different algorithms one finds in literature (such as N4SID IV-4SID MOESP CVA) are discussed and put into a unifying framework. Further a comparison between subspace identification and prediction error methods is made on the basis of computational complexity and precision of the methods by applying them on 10 industrial datasets. Also the issue of statistical consistency of subspace identification methods is briefly discussed. Some extensions of linear subspace methods to other classes of systems such as continuous-time systems bilinear systems time-periodic systems etc. are given. Current software developments and trends in the field of system identification are also discussed including a general public domain database called DAISY containing numerous datasets that can be used to validate system identification algorithms.

[1]  Bjorn Ottersten,et al.  A Subspace Based Instrumental Variable Method for State-Space System Identification , 1994 .

[2]  Joos Vandewalle,et al.  SVD-based subspace methods for multivariable continuous-time systems identification , 1991 .

[3]  Wallace E. Larimore,et al.  Canonical variate analysis in identification, filtering, and adaptive control , 1990, 29th IEEE Conference on Decision and Control.

[4]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[5]  Mats Viberg,et al.  Subspace-based methods for the identification of linear time-invariant systems , 1995, Autom..

[6]  A. Swindlehurst,et al.  Subspace-based signal analysis using singular value decomposition , 1993, Proc. IEEE.

[7]  M. Deistler,et al.  The Analysis of the Asymptotic Variance of Subspace Algorithms , 1997 .

[8]  Basil G. Mertzios,et al.  Realization of singular systems via Markov parameters , 1985 .

[9]  Bart De Moor,et al.  A unifying theorem for three subspace system identification algorithms , 1995, Autom..

[10]  M. Moonen,et al.  On- and off-line identification of linear state-space models , 1989 .

[11]  Lennart Ljung,et al.  Interpretation of Subspace Methods : Consistency Analysis , 1997 .

[12]  F. Lewis.  A survey of linear singular systems , 1986 .

[13]  Bart De Moor,et al.  Subspace algorithms for the stochastic identification problem, , 1993, Autom..

[14]  Michel Verhaegen,et al.  Continuous-Time Subspace Model Identification Method Using Laguerre Filtering , 1997 .

[15]  H. Akçay,et al.  An efficient frequency domain state-space identification algorithm , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[16]  Masafumi Okadat,et al.  Joint Design of Model-Subspace based State-Space Identification and Control , 1997 .

[17]  Erik I. Verriest,et al.  Realization of discrete-time periodic systems from input-output data , 1995 .

[18]  Lennart Ljung,et al.  Subspace identification from closed loop data , 1996, Signal Process..

[19]  En Sup Yoon,et al.  Application of a Bilinear Long-Range Predictive Control Method in a Distillation Process , 1992 .

[20]  B. Wahlberg,et al.  Counterexample to General Consistency of Subspace System Identification Methods , 1997 .

[21]  Bart De Moor,et al.  Continuous-time frequency domain subspace system identification , 1996, Signal Process..

[22]  H. Zeiger,et al.  Approximate linear realizations of given dimension via Ho's algorithm , 1974 .

[23]  Wassily Leontief.  Essays in Economics , 1966 .

[24]  Bo Wahlberg,et al.  A linear regression approach to state-space subspace system identification , 1996, Signal Process..

[25]  Thomas Kailath,et al.  Linear Systems , 1980 .

[26]  Jan C. Willems,et al.  From time series to linear system - Part III: Approximate modelling , 1987, Autom..

[27]  Michel Verhaegen,et al.  Application of a subspace model identification technique to identify LTI systems operating in closed-loop , 1993, Autom..

[28]  Lennart Ljung,et al.  Identification of processes in closed loop - identifiability and accuracy aspects , 1977, Autom..

[29]  Jan Swevers,et al.  A subspace algorithm for the identification of discrete time frequency domain power spectra , 1997, Autom..

[30]  Β. L. HO,et al.  Editorial: Effective construction of linear state-variable models from input/output functions , 1966 .

[31]  Karl Johan Åström,et al.  BOOK REVIEW SYSTEM IDENTIFICATION , 1994, Econometric Theory.

[32]  B. Moore.  Principal component analysis in linear systems: Controllability, observability, and model reduction , 1981 .

[33]  Ioan Doré Landau,et al.  Reduced order bilinear models for distillation columns , 1978, Autom..

[34]  Sun-Yuan Kung,et al.  A new identification and model reduction algorithm via singular value decomposition , 1978 .

[35]  W. Larimore.  System Identification, Reduced-Order Filtering and Modeling via Canonical Variate Analysis , 1983, 1983 American Control Conference.

[36]  Michel Verhaegen,et al.  Identification of the deterministic part of MIMO state space models given in innovations form from input-output data , 1994, Autom..

[37]  Bart De Moor,et al.  Choice of state-space basis in combined deterministic-stochastic subspace identification , 1995, Autom..

[38]  Bo Wahlberg,et al.  Analysis of state space system identification methods based on instrumental variables and subspace fitting , 1997, Autom..

[39]  N. Sinha,et al.  Identification of Continuous-Time Systems: Methodology and Computer Implementation , 1991 .

[40]  J. J. Hench.  A technique for the identification of linear periodic state-space models , 1995 .

[41]  Rik Pintelon,et al.  Identification of Linear Systems: A Practical Guideline to Accurate Modeling , 1991 .

[42]  H. Akaike.  Markovian Representation of Stochastic Processes by Canonical Variables , 1975 .

[43]  Bart De Moor,et al.  Subspace identification of bilinear systems subject to white inputs , 1999, IEEE Trans. Autom. Control..

[44]  Marc Moonen,et al.  A subspace identification algorithm for descriptor systems , 1992 .

[45]  B. Moor,et al.  Numerical Algorithms for Subspace State Space System Identification , 1995 .

[46]  Paul M.J. Van den Hof,et al.  Closed-Loop Issues in System Identification , 1997 .

[47]  Bart De Moor,et al.  An interactive system identification module for Xmath , 1993 .

[48]  Bart De Moor,et al.  A fully interactive system identification module for Xmath (ISID) , 1994 .

[49]  L. Ljung,et al.  Performance of Subspace Based State-Space System Identification Methods , 1993 .

[50]  Uday B. Desai.  Realization of bilinear stochastic systems , 1986 .

[51]  Jan C. Willems,et al.  From time series to linear system - Part I. Finite dimensional linear time invariant systems , 1986, Autom..

[52]  James Demmel,et al.  LAPACK Users' Guide, Third Edition , 1999, Software, Environments and Tools.

[53]  Basil G. Mertzios,et al.  Walsh function analysis of 2-D generalized continuous systems , 1990 .

[54]  B. De Moor,et al.  A bilinear extension of subspace identification for systems subject to white inputs , 1997, Proceedings of the 1997 American Control Conference (Cat. No.97CH36041).

[55]  Lennart Ljung,et al.  System identification toolbox for use with MATLAB , 1988 .

[56]  Thierry Bastogne,et al.  PMF-Based Subspace Method for Continuous-Time Model Identification Deterministic Study , 1997 .

[57]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[58]  Mats Viberg,et al.  Subspace Methods in System Identification , 1994 .

[59]  Lennart Ljung,et al.  A simple start-up procedure for canonical form state space identification, based on subspace approximation , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[60]  Petre Stoica,et al.  Decentralized Control , 2018, The Control Systems Handbook.

[61]  Thomas Kailath,et al.  Fast recursive identification of state space models via exploitation of displacement structure , 1994, Autom..

[62]  Robert N. Jacques,et al.  Frequency domain structural system identification by observability range space extraction , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[63]  T. Gustafsson.  System Identification Using Subspace-Based Instrumental Variable Methods , 1997 .

[64]  H. Aling,et al.  An Interactive System Identification Module for Xmath (ISID) , 1993, 1993 American Control Conference.

[65]  Patrick Dewilde,et al.  Subspace model identification Part 1. The output-error state-space model identification class of algorithms , 1992 .

[66]  Bart De Schutter,et al.  DAISY : A database for identification of systems , 1997 .

[67]  Bart De Moor,et al.  Numerical algorithms for state space subspace system identification , 1993 .

[68]  Petre Stoica,et al.  Order Estimation Method for Subspace-Based System Identification , 1997 .

[69]  Phillip L. Ainsleigh,et al.  Observations on oblique projectors and pseudoinverses , 1997, IEEE Trans. Signal Process..

[70]  B. De Moor,et al.  Subspace identification of balanced deterministic bilinear systems subject to white inputs , 1997, 1997 European Control Conference (ECC).

[71]  Manfred Deistler,et al.  Consistency and relative efficiency of subspace methods , 1994, Autom..

[72]  B. Moor,et al.  A geometrical strategy for the identification of state space models of linear multivariable systems with singular value decomposition , 1987 .

[73]  Gwilym M. Jenkins,et al.  Time series analysis, forecasting and control , 1972 .

[74]  Bart De Moor,et al.  Identification of the first order parameters of a circulant modulated Poisson process , 1998 .

[75]  T. Kailath,et al.  Fast identification of state-space models via exploitation of displacement structure , 1994, IEEE Trans. Autom. Control..

[76]  Jan M. Maciejowski,et al.  Realization of stable models with subspace methods , 1996, Autom..

[77]  Kiyoshi Wada,et al.  Subspace Model Identification for Continuous-Time Systems , 1997 .

[78]  P. Faurre.  Stochastic Realization Algorithms , 1976 .

[79]  K. Liu.  Identification of multi-input multi-output systems by observability range space extraction , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.