Toeplitz and Circulant Matrices: A Review

The fundamental theorems on the asymptotic behavior of eigenvalues, inverses, and products of banded Toeplitz matrices and Toeplitz matrices with absolutely summable elements are derived in a tutorial manner. Mathematical elegance and generality are sacrificed for conceptual simplicity and insight in the hope of making these results available to engineers lacking either the background or endurance to attack the mathematical literature on the subject. By limiting the generality of the matrices considered, the essential ideas and results can be conveyed in a more intuitive manner without the mathematical machinery required for the most general cases. As an application the results are applied to the study of the covariance matrices and their factors of linear models of discrete time random processes.

[1]  A. Hoffman,et al.  The variation of the spectrum of a normal matrix , 1953 .

[2]  J. G. Wendel,et al.  Statistical analysis of stationary time series , 1958 .

[3]  U. Grenander,et al.  Statistical analysis of stationary time series , 1958 .

[4]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[5]  L. Mirsky,et al.  The Theory of Matrices , 1961, The Mathematical Gazette.

[6]  G. Baxter.  An Asymptotic Result for the Finite Predictor. , 1962 .

[7]  G. Baxter.  A norm inequality for a “finite-section” Wiener-Hopf equation , 1963 .

[8]  W. Rudin.  Principles of mathematical analysis , 1964 .

[9]  Jorma Rissanen,et al.  Properties of infinite covariance matrices and stability of optimum predictors , 1969, Inf. Sci..

[10]  Peter Lancaster,et al.  The theory of matrices , 1969 .

[11]  Charles L. Rino,et al.  The inversion of covariance matrices by finite Fourier transforms (Corresp.) , 1970, IEEE Trans. Inf. Theory.

[12]  Robert M. Gray,et al.  Information rates of autoregressive processes , 1970, IEEE Trans. Inf. Theory.

[13]  J. H. Wilkinson.  Elementary proof of the Wielandt-Hoffman Theorem and of its generalization , 1970 .

[14]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[15]  Robert M. Gray,et al.  On the asymptotic eigenvalue distribution of Toeplitz matrices , 1972, IEEE Trans. Inf. Theory.

[16]  Judea Pearl,et al.  On coding and filtering stationary signals by discrete Fourier transforms (Corresp.) , 1973, IEEE Trans. Inf. Theory.

[17]  Robert M. Gray,et al.  On Unbounded Toeplitz Matrices and Nonstationary Time Series with an Application to Information Theory , 1974, Inf. Control..

[18]  Takeshi Hashimoto,et al.  On the rate-distortion function for the nonstationary Gaussian autoregressive process (Corresp.) , 1980, IEEE Trans. Inf. Theory.

[19]  F. R. Gantmakher.  The Theory of Matrices , 1984 .

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[21]  E. E. Tyrtyshnikov.  Influence of matrix operations on the distribution of Eigenvalues and singular values of Toeplitz matrices , 1994 .

[22]  E. E. Tyrtyshnikov.  A unifying approach to some old and new theorems on distribution and clustering , 1996 .

[23]  A. Böttcher,et al.  Introduction to Large Truncated Toeplitz Matrices , 1998 .

[24]  W. F. Trench.  Asymptotic distribution of the even and odd spectra of real symmetric Toeplitz matrices , 1999 .

[25]  D. Fasino,et al.  Spectral clustering properties of block multilevel Hankel matrices , 2000 .

[26]  A. Böttcher,et al.  Toeplitz Matrices, Asymptotic Linear Algebra, and Functional Analysis , 2000 .

[27]  W. F. Trench.  Absolute Equal Distribution of Families of Finite Sets , 2002 .

[28]  W. F. Trench.  A Note on Asymptotic Zero Distribution of Orthogonal Polynomials , 2003 .

[29]  W. F. Trench.  Simplification and Strengthening of Weyl's Definition of Asymptotic Equal Distribution of Two Families of Finite Sets , 2003 .

[30]  W. F. Trench.  Absolute equal distribution of the spectra of Hermitian matrices , 2003 .

[31]  Errol C. Caby.  An Introduction to Statistical Signal Processing , 2006, Technometrics.

[32]  W. F. Trench.  Absolute equal distribution of the eigenvalues of discrete Sturm–Liouville problems , 2006 .