Multilinear Control Systems Theory

In this paper, we provide a system theoretic treatment of a new class of multilinear time-invariant (MLTI) systems in which the states, inputs and outputs are tensors, and the system evolution is governed by multilinear operators. The MLTI system representation is based on the Einstein product and even-order paired tensors. There is a particular tensor unfolding which gives rise to an isomorphism from this tensor space to the general linear group, i.e. the group of invertible matrices. By leveraging this unfolding operation, one can extend classical linear time-invariant (LTI) system notions including stability, reachability and observability to MLTI systems. While the unfolding based formulation is a powerful theoretical construct, the computational advantages of MLTI systems can only be fully realized while working with the tensor form, where hidden patterns/structures can be exploited for efficient representations and computations. Along these lines, we establish new results which enable one to express tensor unfolding based stability, reachability and observability criteria in terms of more standard notions of tensor ranks/decompositions. In addition, we develop a generalized CANDECOMP/PARAFAC decomposition and tensor train decomposition based model reduction framework, which can significantly reduce the number of MLTI system parameters. We demonstrate our framework with numerical examples.

[1]  Stefan Klus,et al.  Tensor-based dynamic mode decomposition , 2016, Nonlinearity.

[2]  Michael K. Ng,et al.  An eigenvalue problem for even order tensors with its applications , 2016 .

[3]  Thomas Kailath,et al.  Linear Systems , 1980 .

[4]  Kai Kruppa,et al.  Comparison of Tensor Decomposition Methods for Simulation of Multilinear Time-Invariant Systems with the MTI Toolbox , 2017 .

[5]  Zheng-Hai Huang,et al.  Positive definiteness of paired symmetric tensors and elasticity tensors , 2017, J. Comput. Appl. Math..

[6]  A. Einstein.  The Foundation of the General Theory of Relativity , 1916 .

[7]  Pierre Baldi,et al.  Genome Architecture Mediates Transcriptional Control of Human Myogenic Reprogramming , 2018, iScience.

[8]  Boris N. Khoromskij,et al.  Computation of extreme eigenvalues in higher dimensions using block tensor train format , 2013, Comput. Phys. Commun..

[9]  Stephen Smale,et al.  Functional organization of the human 4D Nucleome , 2015, Proceedings of the National Academy of Sciences.

[10]  Ezra Zeheb,et al.  Model reduction of uncertain systems retaining the uncertainty structure , 2005, Syst. Control. Lett..

[11]  R. Brockett.  Finite Dimensional Linear Systems , 2015 .

[12]  Anthony Bloch,et al.  Algorithm for cellular reprogramming , 2017, Proceedings of the National Academy of Sciences.

[13]  Charles Van Loan,et al.  Block Tensor Unfoldings , 2011, SIAM J. Matrix Anal. Appl..

[14]  Kai Liu,et al.  Tensor-based linear dynamical systems for action recognition from 3D skeletons , 2018, Pattern Recognit..

[15]  Liqun Qi,et al.  Eigenvalues of a real supersymmetric tensor , 2005, J. Symb. Comput..

[16]  Markus Weimar.  Breaking the curse of dimensionality , 2015 .

[17]  Erik G. Larsson,et al.  Lecture Notes: Floating-Point Numbers , 2010 .

[18]  T. Kolda.  Multilinear operators for higher-order decompositions , 2006 .

[19]  Fan Yang,et al.  Tensor and its tucker core: The invariance relationships , 2016, Numer. Linear Algebra Appl..

[20]  Charles Van Loan,et al.  Block tensors and symmetric embeddings , 2010, ArXiv.

[21]  B. Zheng,et al.  Tensor inversion and its application to the tensor equations with Einstein product , 2018, Linear and Multilinear Algebra.

[22]  Bobbi Jo Broxson.  The Kronecker Product , 2006 .

[23]  A. Stegeman,et al.  On Kruskal's uniqueness condition for the Candecomp/Parafac decomposition , 2007 .

[24]  C. Loan.  Structured Matrix Problems from Tensors , 2016 .

[25]  Lek-Heng Lim,et al.  Singular values and eigenvalues of tensors: a variational approach , 2005, 1st IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, 2005..

[26]  Lei Li,et al.  Multilinear Dynamical Systems for Tensor Time Series , 2013, NIPS.

[27]  Na Li,et al.  Solving Multilinear Systems via Tensor Inversion , 2013, SIAM J. Matrix Anal. Appl..

[28]  Changjiang Bu,et al.  Moore–Penrose inverse of tensors via Einstein product , 2016 .

[29]  Mark Groudine,et al.  On emerging nuclear order , 2011, The Journal of cell biology.

[30]  Ivan Oseledets,et al.  Tensor-Train Decomposition , 2011, SIAM J. Sci. Comput..

[31]  Nikos D. Sidiropoulos,et al.  Parallel factor analysis in sensor array processing , 2000, IEEE Trans. Signal Process..

[32]  Luigi Fortuna,et al.  Model Order Reduction Techniques with Applications in Electrical Engineering , 1992 .

[33]  Joos Vandewalle,et al.  A Multilinear Singular Value Decomposition , 2000, SIAM J. Matrix Anal. Appl..

[34]  Tamara G. Kolda,et al.  Tensor Decompositions and Applications , 2009, SIAM Rev..

[35]  David Rubin,et al.  Introduction to Continuum Mechanics , 2009 .

[36]  Vin de Silva,et al.  Tensor rank and the ill-posedness of the best low-rank approximation problem , 2006, math/0607647.

[37]  B. Anderson,et al.  Model reduction for control system design , 1984 .

[38]  Qingwen Wang,et al.  Tensor decompositions and tensor equations over quaternion algebra , 2017, 1710.07552.