Frequency Domain Subspace Identification Using Nuclear Norm Minimization and Hankel Matrix Realizations

Subspace identification techniques have gained widespread acceptance as a method of obtaining a low-order model from data. These are based on using the singular-value decomposition as a means of estimating the underlying system order and extracting a basis for the extended observability space. In the presence of noise rank determination becomes difficult and the low rank estimates lose the structure required for exact realizability. Furthermore the noise corrupts the singular values in a manner that is inconsistent with physical noise processes. These problems are addressed by an optimization based approach using a nuclear norm minimization objective. By using Hankel matrices as the underlying data structure exact realizability of the low rank system models is maintained. Noise in the data enters the formulation linearly, allowing for the inclusion of more realistic noise weightings. A cumulative spectral weight is presented and shown to be useful in estimating models from data corrupted via noise. A numerical example illustrates the characteristics of the problem.

[1]  Carolyn L. Beck,et al.  Model reduction of multidimensional and uncertain systems , 1994, IEEE Trans. Autom. Control..

[2]  Lieven Vandenberghe,et al.  Interior-Point Method for Nuclear Norm Approximation with Application to System Identification , 2009, SIAM J. Matrix Anal. Appl..

[3]  Manfred Morari,et al.  System identification via nuclear norm regularization for simulated moving bed processes from incomplete data sets , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[4]  Stephen P. Boyd,et al.  Graph Implementations for Nonsmooth Convex Programs , 2008, Recent Advances in Learning and Control.

[5]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[6]  Mustafa Ayazoglu,et al.  An algorithm for fast constrained nuclear norm minimization and applications to systems identification , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[7]  A. Tether.  Construction of minimal linear state-variable models from finite input-output data , 1970 .

[8]  H. Hjalmarsson,et al.  Identification of Box-Jenkins Models Using Structured ARX Models and Nuclear Norm Relaxation , 2012 .

[9]  M. Fazel,et al.  Reweighted nuclear norm minimization with application to system identification , 2010, Proceedings of the 2010 American Control Conference.

[10]  Munther A. Dahleh,et al.  Identification in the presence of classes of unmodeled dynamics and noise , 1997, IEEE Trans. Autom. Control..

[11]  Patrick Dewilde,et al.  Subspace model identification Part 1. The output-error state-space model identification class of algorithms , 1992 .

[12]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[13]  F. Paganini.  A set-based approach for white noise modeling , 1996, IEEE Trans. Autom. Control..

[14]  P. M. J. V. den,et al.  Approximate realization based upon an alternative to the Hankel matrix : the Page matrix , 2004 .

[15]  Roy S. Smith,et al.  Nuclear norm minimization methods for frequency domain subspace identification , 2012, 2012 American Control Conference (ACC).

[16]  J. Vandewalle,et al.  Analysis and properties of the generalized total least squares problem AX≈B when some or all columns in A are subject to error , 1989 .

[17]  Zhang Liu,et al.  Subspace system identification via weighted nuclear norm optimization , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[18]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[19]  Jerry M. Mendel,et al.  The constrained total least squares technique and its applications to harmonic superresolution , 1991, IEEE Trans. Signal Process..

[20]  Takashi Tanaka,et al.  Blind Source Separation by Nuclear Norm Minimization and Local Recoverability Analysis , 2013, IEEE Signal Processing Letters.

[21]  Lennart Ljung,et al.  A statistical perspective on state-space modeling using subspace methods , 1991, [1991] Proceedings of the 30th IEEE Conference on Decision and Control.

[22]  M. Verhaegen.  Subspace model identification Part 2. Analysis of the elementary output-error state-space model identification algorithm , 1992 .

[23]  Stephen P. Boyd,et al.  A rank minimization heuristic with application to minimum order system approximation , 2001, Proceedings of the 2001 American Control Conference. (Cat. No.01CH37148).

[24]  F. Fairman,et al.  Derivation of the Ho algorithm , 1974 .

[25]  B. Schutter,et al.  Minimal state-space realization in linear system theory: an overview , 2000 .

[26]  L. Ljung,et al.  Subspace-based multivariable system identification from frequency response data , 1996, IEEE Trans. Autom. Control..

[27]  Sabine Van Huffel,et al.  Block-row Hankel weighted low rank approximation , 2006, Numer. Linear Algebra Appl..

[28]  Β. L. HO,et al.  Editorial: Effective construction of linear state-variable models from input/output functions , 1966 .