Geometric methods for estimation of structured covariances

Author(s): Ning, Lipeng; Jiang, Xianhua; Georgiou, Tryphon | Abstract: We consider problems of estimation of structured covariance matrices, and in particular of matrices with a Toeplitz structure. We follow a geometric viewpoint that is based on some suitable notion of distance. To this end, we overview and compare several alternatives metrics and divergence measures. We advocate a specific one which represents the Wasserstein distance between the corresponding Gaussians distributions and show that it coincides with the so-called Bures/Hellinger distance between covariance matrices as well. Most importantly, besides the physically appealing interpretation, computation of the metric requires solving a linear matrix inequality (LMI). As a consequence, computations scale nicely for problems involving large covariance matrices, and linear prior constraints on the covariance structure are easy to handle. We compare this transportation/Bures/Hellinger metric with the maximum likelihood and the Burg methods as to their performance with regard to estimation of power spectra with spectral lines on a representative case study from the literature.

[1]  D. Luenberger,et al.  Estimation of structured covariance matrices , 1982, Proceedings of the IEEE.

[2]  R. Bhatia Positive Definite Matrices , 2007 .

[3]  M. Knott,et al.  On the optimal mapping of distributions , 1984 .

[4]  A. Uhlmann The Metric of Bures and the Geometric Phase. , 1992 .

[5]  Yann Brenier,et al.  A computational fluid mechanics solution to the Monge-Kantorovich mass transfer problem , 2000, Numerische Mathematik.

[6]  D. Kinderlehrer,et al.  THE VARIATIONAL FORMULATION OF THE FOKKER-PLANCK EQUATION , 1996 .

[7]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[8]  I. Olkin,et al.  The distance between two random vectors with given dispersion matrices , 1982 .

[9]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[10]  J. Cadzow Maximum Entropy Spectral Analysis , 2006 .

[11]  S. Haykin Nonlinear Methods of Spectral Analysis , 1980 .

[12]  Jian Li,et al.  A new method for moving-average parameter estimation , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[13]  Michele Pavon,et al.  Hellinger Versus Kullback–Leibler Multivariable Spectrum Approximation , 2007, IEEE Transactions on Automatic Control.

[14]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[15]  Shun-ichi Amari,et al.  Differential-geometrical methods in statistics , 1985 .

[16]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[17]  Tryphon T. Georgiou,et al.  The structure of state covariances and its relation to the power spectrum of the input , 2002, IEEE Trans. Autom. Control..

[18]  甘利 俊一 Differential-geometrical methods in statistics , 1985 .

[19]  D. Petz Geometry of canonical correlation on the state space of a quantum system , 1994 .

[20]  N. Čencov Statistical Decision Rules and Optimal Inference , 2000 .

[21]  T. Georgiou Distances between time-series and their autocorrelation statistics , 2007, math/0701181.