Estimation of rank deficient covariance matrices with Kronecker structure

Given a set of observations, the estimation of covariance matrices is required in the analysis of many applications. To this end, any know structure of the covariance matrix can be taken into account. For instance, in case of separable processes, the covariance matrix is given by the Kronecker product of two factor matrices. Assuming the covariance matrix is full rank, the maximum likelihood (ML) estimate in this case leads to an iterative algorithm known as the flip-flop algorithm in the literature. In this work, we first generalize the flip-flop algorithm to the case when the covariance matrix is rank deficient, which happens to be the case in several situations. In addition, we propose a non-iterative estimation approach which incurs in a performance loss compared to the ML estimate, but at the expense of less complexity.

[1]  Gene H. Golub,et al.  Linear algebra for large scale and real-time applications , 1993 .

[2]  C. Loan The ubiquitous Kronecker product , 2000 .

[3]  P. Dutilleul The mle algorithm for the matrix normal distribution , 1999 .

[4]  Hongbin Li,et al.  Knowledge-Aided Parametric Tests for Multichannel Adaptive Signal Detection , 2011, IEEE Transactions on Signal Processing.

[5]  B. Ottersten,et al.  ML Estimation of Covariance Matrices with Kronecker and Persymmetric Structure , 2009, 2009 IEEE 13th Digital Signal Processing Workshop and 5th IEEE Signal Processing Education Workshop.

[6]  Lourens J. Waldorp,et al.  Spatiotemporal EEG/MEG source analysis based on a parametric noise covariance model , 2002, IEEE Transactions on Biomedical Engineering.

[7]  Preben E. Mogensen,et al.  A stochastic MIMO radio channel model with experimental validation , 2002, IEEE J. Sel. Areas Commun..

[8]  Petre Stoica,et al.  Kronecker Structured Covariance Matrix Estimation , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  Lourens J. Waldorp,et al.  Estimating stationary dipoles from MEG/EEG data contaminated with spatially and temporally correlated background noise , 2001, NeuroImage.

[10]  C. Loan,et al.  Approximation with Kronecker Products , 1992 .

[11]  Magnus Jansson,et al.  On Toeplitz and Kronecker structured covariance matrix estimation , 2010, 2010 IEEE Sensor Array and Multichannel Signal Processing Workshop.

[12]  Fetsje Bijma,et al.  The spatiotemporal MEG covariance matrix modeled as a sum of Kronecker products , 2005, NeuroImage.

[13]  Alfred O. Hero,et al.  Sparse covariance estimation under Kronecker product structure , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Petre Stoica,et al.  On Estimation of Covariance Matrices With Kronecker Product Structure , 2008, IEEE Transactions on Signal Processing.

[15]  Ernst Bonek,et al.  A stochastic MIMO channel model with joint correlation of both link ends , 2006, IEEE Transactions on Wireless Communications.

[16]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .