Multilinear state space system identification with matrix product operators

Abstract In this article, we introduce a matrix product operator, also called tensor train matrix, representation of discrete-time multilinear state space models and develop a corresponding system identification method. Using matrix product operators allows us to store the exponential number of model coefficients with a linear storage complexity. The derived system identification algorithm estimates the matrix product operator of the multilinear state space model directly from the measured data. This results in lower computational complexity compared to traditional nonlinear optimization methods. The effectiveness of our proposed model and method is demonstrated by a numerical experiment, where the identification of a degree-16 multilinear state space system in MATLAB on a standard desktop computer takes about 8 minutes with a relative validation error of 0.003%.

[1]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[2]  Tohru Katayama,et al.  Subspace Methods for System Identification , 2005 .

[3]  Lennart Ljung,et al.  System Identification: Theory for the User , 1987 .

[4]  E. Tyrtyshnikov,et al.  TT-cross approximation for multidimensional arrays , 2010 .

[5]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[6]  M. Arbib A characterization of multilinear systems , 1969 .

[7]  Masashi Sugiyama,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 2 Applications and Future Perspectives , 2017, Found. Trends Mach. Learn..

[8]  Kai Kruppa,et al.  Comparison of Tensor Decomposition Methods for Simulation of Multilinear Time-Invariant Systems with the MTI Toolbox , 2017 .

[9]  N. Wiener,et al.  Nonlinear Problems in Random Theory , 1964 .

[10]  Ivan V. Oseledets,et al.  Approximation of 2d˟2d Matrices Using Tensor Decomposition , 2010, SIAM J. Matrix Anal. Appl..

[11]  Jan Swevers,et al.  Identification of nonlinear systems using Polynomial Nonlinear State Space models , 2010, Autom..

[12]  Ngai Wong,et al.  Tensor Network alternating linear scheme for MIMO Volterra system identification , 2016, Autom..

[13]  Bart De Moor,et al.  N4SID: Subspace algorithms for the identification of combined deterministic-stochastic systems , 1994, Autom..

[14]  Andrzej Cichocki,et al.  Tensor Networks for Dimensionality Reduction and Large-scale Optimization: Part 1 Low-Rank Tensor Decompositions , 2016, Found. Trends Mach. Learn..

[15]  Reinhold Schneider,et al.  The Alternating Linear Scheme for Tensor Optimization in the Tensor Train Format , 2012, SIAM J. Sci. Comput..