The Circulant Rational Covariance Extension Problem: The Complete Solution

The rational covariance extension problem to determine a rational spectral density given a finite number of covariance lags can be seen as a matrix completion problem to construct an infinite-dimensional positive-definite Toeplitz matrix the northwest corner of which is given. The circulant rational covariance extension problem considered in this paper is a modification of this problem to partial stochastic realization of periodic stationary process, which are better represented on the discrete unit circle rather than on the discrete real line . The corresponding matrix completion problem then amounts to completing a finite-dimensional Toeplitz matrix that is circulant. Another important motivation for this problem is that it provides a natural approximation, involving only computations based on the fast Fourier transform, for the ordinary rational covariance extension problem, potentially leading to an efficient numerical procedure for the latter. The circulant rational covariance extension problem is an inverse problem with infinitely many solutions in general, each corresponding to a bilateral ARMA representation of the underlying periodic process. In this paper, we present a complete smooth parameterization of all solutions and convex optimization procedures for determining them. A procedure to determine which solution that best matches additional data in the form of logarithmic moments is also presented.

[1]  M. Kreĭn,et al.  The Markov Moment Problem and Extremal Problems , 1977 .

[2]  C. Byrnes,et al.  On the partial stochastic realization problem , 1997, IEEE Trans. Autom. Control..

[3]  Ruggero Frezza,et al.  Gaussian reciprocal processes and self-adjoint stochastic differential equations of second order , 1991 .

[4]  N. Wiener,et al.  The prediction theory of multivariate stochastic processes , 1957 .

[5]  Anders Lindquist,et al.  Interior point solutions of variational problems and global inverse function theorems , 2007 .

[6]  Anders Lindquist,et al.  The Moment Problem for Rational Measures: Convexity in the Spirit of Krein , 2009 .

[7]  Hilary A. Priestley,et al.  Introduction to Complex Analysis , 1985 .

[8]  P. Masani The prediction theory of multivariate stochastic processes, III , 1960 .

[9]  F. Smithies Linear Operators , 2019, Nature.

[10]  P. Enqvist,et al.  A Convex Optimization Approach to ARMA(n, m) Model Design from Covariance and Cepstral Data , 2004, SIAM J. Control. Optim..

[11]  Francesca P. Carli,et al.  On the Covariance Completion Problem Under a Circulant Structure , 2011, IEEE Transactions on Automatic Control.

[12]  Anders Lindquist,et al.  Identifiability and Well-Posedness of Shaping-Filter Parameterizations: A Global Analysis Approach , 2002, SIAM J. Control. Optim..

[13]  Michele Pavon,et al.  On the Geometry of Maximum Entropy Problems , 2011, SIAM Rev..

[14]  R. Kálmán Realization of Covariance Sequences , 1982 .

[15]  Tryphon T. Georgiou,et al.  Kullback-Leibler approximation of spectral density functions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[16]  P. Enqvist Spectral Estimation by Geometric, Topological and Optimization Methods , 2001 .

[17]  Arthur J. Krener,et al.  Realizations of reciprocal processes , 1988 .

[18]  Anders Lindquist,et al.  Important Moments in Systems and Control , 2008, SIAM J. Control. Optim..

[19]  A. Chiuso,et al.  Reciprocal realization and modeling of textured images , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  Francesca P. Carli,et al.  A Maximum Entropy Solution of the Covariance Extension Problem for Reciprocal Processes , 2011, IEEE Transactions on Automatic Control.

[21]  C. Byrnes,et al.  The Generalized Moment Problem with Complexity Constraint , 2006 .

[22]  S. R. Simanca,et al.  On Circulant Matrices , 2012 .

[23]  BERNARD C. LEVY,et al.  Characterization of Stationary Discrete-Time Gaussian Reciprocal Processes over a Finite Interval , 2002, SIAM J. Matrix Anal. Appl..

[24]  C. Byrnes,et al.  A Convex Optimization Approach to the Rational Covariance Extension Problem , 1999 .

[25]  Leiba Rodman,et al.  Abstract Band Method Via Factorization, Positive and Band Extensions of Multivariable Almost Periodic Matrix Functions, and Spectral Estimation , 2002 .

[26]  Tryphon T. Georgiou,et al.  Kullback-Leibler approximation of spectral density functions , 2003, IEEE Trans. Inf. Theory.

[27]  B. Jamison,et al.  Reciprocal Processes: The Stationary Gaussian Case , 1970 .

[28]  Anders Lindquist,et al.  From Finite Covariance Windows to Modeling Filters: A Convex Optimization Approach , 2001, SIAM Rev..

[29]  J. Schwartz,et al.  Linear Operators. Part I: General Theory. , 1960 .

[30]  Anders Lindquist,et al.  Cepstral coefficients, covariance lags, and pole-zero models for finite data strings , 2001, IEEE Trans. Signal Process..

[31]  Robert M. Gray,et al.  Toeplitz and Circulant Matrices: A Review , 2005, Found. Trends Commun. Inf. Theory.

[32]  M. Pavon,et al.  Further Results on the Byrnes-Georgiou-Lindquist Generalized Moment Problem , 2007 .

[33]  B. Jamison Reciprocal processes , 1974 .

[34]  A. Krener,et al.  Modeling and estimation of discrete-time Gaussian reciprocal processes , 1990 .

[35]  C. Byrnes,et al.  A complete parameterization of all positive rational extensions of a covariance sequence , 1995, IEEE Trans. Autom. Control..

[36]  I. Gohberg,et al.  Classes of Linear Operators , 1990 .

[37]  Francesca P. Carli,et al.  Modelling and Simulation of Images by Reciprocal Processes , 2008, Tenth International Conference on Computer Modeling and Simulation (uksim 2008).

[38]  Tryphon T. Georgiou,et al.  Realization of power spectra from partial covariance sequences , 1987, IEEE Trans. Acoust. Speech Signal Process..

[39]  Tryphon T. Georgiou,et al.  Solution of the general moment problem via a one-parameter imbedding , 2005, IEEE Transactions on Automatic Control.

[40]  H. Dym,et al.  Extensions of band matrices with band inverses , 1981 .