Subspace algorithms for identifying separable-in-denominator 2D systems with deterministic–stochastic inputs

ABSTRACT In this paper, we present an algorithm for identifying two-dimensional (2D) causal, recursive and separable-in-denominator (CRSD) state-space models in the Roesser form with deterministic–stochastic inputs. The algorithm implements the N4SID, PO-MOESP and CCA methods, which are well known in the literature on 1D system identification, but here we do so for the 2D CRSD Roesser model. The algorithm solves the 2D system identification problem by maintaining the constraint structure imposed by the problem (i.e. Toeplitz and Hankel) and computes the horizontal and vertical system orders, system parameter matrices and covariance matrices of a 2D CRSD Roesser model. From a computational point of view, the algorithm has been presented in a unified framework, where the user can select which of the three methods to use. Furthermore, the identification task is divided into three main parts: (1) computing the deterministic horizontal model parameters, (2) computing the deterministic vertical model parameters and (3) computing the stochastic components. Specific attention has been paid to the computation of a stabilised Kalman gain matrix and a positive real solution when required. The efficiency and robustness of the unified algorithm have been demonstrated via a thorough simulation example.

[1]  M. Kosaka,et al.  Recursive filtering algorithm for a two-dimensional system , 1979 .

[2]  Jason Sheng-Hong Tsai,et al.  Modeling of Variable Coefficient Roesser Model for Systems Described by Second-Order Partial Differential Equation , 2003 .

[3]  G. E. Antoniou,et al.  Minimal state-space realization of factorable 2-D transfer functions , 1988 .

[4]  Victor Sreeram,et al.  Identification and model reduction of 2-D systems via the extended impulse response Gramians , 1998, Autom..

[5]  V. Sreeram,et al.  Balanced identification and model reduction of a separable denominator 2-D system , 2004, 2004 5th Asian Control Conference (IEEE Cat. No.04EX904).

[6]  M. Verhaegen,et al.  A spatial canonical approach to multidimensional state-space identification for distributed parameter systems , 2005, The Fourth International Workshop on Multidimensional Systems, 2005. NDS 2005..

[7]  B. Moor,et al.  Subspace identification for linear systems , 1996 .

[8]  Darrell A. Turkington,et al.  Generalised vec operators and the seemingly unrelated regression equations model with vector correlated disturbances , 2000 .

[9]  Andreas Antoniou,et al.  Synthesis of 2-D state-space fixed-point digital-filter structures with minimum roundoff noise , 1986 .

[10]  A. Habibi.  Two-dimensional Bayesian estimate of images , 1972 .

[11]  Michel Verhaegen,et al.  Filtering and System Identification: Frontmatter , 2007 .

[12]  Bart De Schutter,et al.  Identification of distributed-parameter systems with missing data , 2012, 2012 IEEE International Conference on Control Applications.

[13]  D. P. Cunha,et al.  Reduced order state-space models for 2-D systems , 2013 .

[14]  G. E. Colling,et al.  New Results in 2-D Systems Theory, Part II: 2-D State-Space Models-Realization and the Notions of Controllability, Observability, and Minimality , 1977 .

[15]  Ettore Fornasini,et al.  Doubly-indexed dynamical systems: State-space models and structural properties , 1978, Mathematical systems theory.

[16]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[17]  Lennart Ljung,et al.  A novel subspace identification approach with enforced causal models , 2005, Autom..

[18]  Krzysztof Galkowski.  Higher order discretization of 2-D systems , 2000 .

[19]  Ahmed Alenany,et al.  Subspace algorithms for identifying separable-in-denominator two-dimensional systems with deterministic inputs , 2011 .

[20]  Leonard M. Silverman,et al.  Nonlinear image restoration: A visual quality constrained approach , 1982, ICASSP.

[21]  Bart De Moor,et al.  Subspace Identification for Linear Systems: Theory ― Implementation ― Applications , 2011 .

[22]  J. Magnus,et al.  Matrix Differential Calculus with Applications in Statistics and Econometrics , 1991 .

[23]  Eric Rogers,et al.  Subspace Identification of Process Dynamics for Iterative Learning Control , 2013 .

[24]  S. Attasi.  Modelling and Recursive Estimation for Double Indexed Sequences , 1976 .

[25]  T. Katayama.  Subspace identification of combined deterministic-stochastic systems by LQ decomposition , 2010, Proceedings of the 2010 American Control Conference.

[26]  M. Morf,et al.  New results in 2-D systems theory, part II: 2-D state-space models—Realization and the notions of controllability, observability, and minimality , 1977, Proceedings of the IEEE.

[27]  J. Ramos,et al.  A subspace algorithm for identifying 2-D separable in denominator filters , 1994 .

[28]  Donald D. Givone,et al.  Multidimensional Linear Iterative Circuits - General Properties , 1972, IEEE Trans. Computers.

[29]  W. Larimore.  System Identification, Reduced-Order Filtering and Modeling via Canonical Variate Analysis , 1983, 1983 American Control Conference.

[30]  Michel Verhaegen,et al.  Identification of the deterministic part of MIMO state space models given in innovations form from input-output data , 1994, Autom..

[31]  W. Marszalek.  Two-dimensional state-space discrete models for hyperbolic partial differential equations , 1984 .

[32]  Eric Rogers,et al.  Analysis of Linear Iterative Learning Control Schemes - A 2D Systems/Repetitive Processes Approach , 2000, Multidimens. Syst. Signal Process..

[33]  Dali Wang,et al.  Modular structure realizations of 2-D separable-in-denominator recursive digital filters , 2007, Signal Process..

[34]  Sun-Yuan Kung,et al.  New results in 2-D systems theory, part I: 2-D polynomial matrices, factorization, and coprimeness , 1977, Proceedings of the IEEE.

[35]  A counterexample to 2-D Lyapunov equations by Mertzios , 1985 .

[36]  S. Liberty,et al.  Linear Systems , 2010, Scientific Parallel Computing.

[37]  Michael K. Ng,et al.  Blind Deconvolution and Structured Matrix Computations with Applications to Array Imaging , 2006 .

[38]  Robert T. Wirski.  On the realization of 2-D orthogonal state-space systems , 2008, Signal Process..

[39]  Peter C. Young,et al.  Instrumental variable methods for identifying partial differential equation models of distributed parameter systems , 2012 .

[40]  Michel Verhaegen,et al.  Efficient System Identification of Heterogeneous Distributed Systems via a Structure Exploiting Extended Kalman Filter , 2011, IEEE Transactions on Automatic Control.

[41]  Huilan Shang,et al.  A STATE SPACE APPROACH FOR BOUNDARY CONTROL OF DISTRIBUTED PARAMETER SYSTEMS , 2006 .

[42]  Masayuki Kawamata,et al.  Decomposition of 2-D separable-denominator systems: Existence, uniqueness, and applications , 1987 .

[43]  Tao Ding,et al.  Robust Identification of 2-D Periodic Systems with Applications to Texture Synthesis and Classification , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[44]  L. Silverman,et al.  Restoration of motion degraded images , 1975 .

[45]  T. Kaczorek.  Two-Dimensional Linear Systems , 1985 .

[46]  J. Kurek,et al.  Iterative learning control synthesis based on 2-D system theory , 1993, IEEE Trans. Autom. Control..

[47]  Mahmood R. Azimi-Sadjadi,et al.  Two-dimensional block Kalman filtering for image restoration , 1987, IEEE Trans. Acoust. Speech Signal Process..

[48]  Herbert Werner,et al.  Identification of spatially interconnected systems , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[49]  Leonard M. Silverman,et al.  Recursive estimation of two-dimensional processes with application to image processing , 1986 .

[50]  Régis Ouvrard,et al.  Identification of 2D Roesser models by using linear fractional transformations , 2014, 2014 European Control Conference (ECC).

[51]  E. Rogers,et al.  Positive real control of two-dimensional systems: Roesser models and linear repetitive processes , 2003 .

[52]  Brian D. O. Anderson,et al.  Stability and the matrix Lyapunov equation for discrete 2-dimensional systems , 1986 .

[53]  Giorgio Picci,et al.  Realization of stochastic systems with exogenous inputs and subspace identification methods , 1999, Autom..

[54]  A. Zilouchian,et al.  Identification of Two-Dimensional State Space Discrete Systems Using Neural Networks , 1999 .

[55]  J. Kurek,et al.  The general state-space model for a two-dimensional linear digital system , 1985 .

[56]  Tohru Katayama,et al.  Subspace Methods for System Identification , 2005 .

[57]  Anton Kummert,et al.  Control law design for discrete linear repetitive processes with non-local updating structures , 2013, Multidimens. Syst. Signal Process..

[58]  T. Hinamoto,et al.  Realizations of a state-space model from two-dimensional input-output map , 1980 .

[59]  V. Verdult,et al.  Filtering and System Identification: A Least Squares Approach , 2007 .

[60]  J. Mendel,et al.  Modeling and recursive state estimation for two-dimensional noncausal filters with applications in image restoration , 1987 .

[61]  T. Hinamoto.  On the partial realization from two-dimensional input- output map , 1981 .

[62]  Cishen Zhang,et al.  H2 and mixed H2/Hinfinity control of two-dimensional systems in Roesser model , 2006, Autom..

[63]  Leonard M. Silverman,et al.  Approximation of 2-D separable in denominator filters , 1983 .

[64]  R. Roesser.  A discrete state-space model for linear image processing , 1975 .