On Estimation of Covariance Matrices With Kronecker Product Structure

The estimation of signal covariance matrices is a crucial part of many signal processing algorithms. In some applications, the structure of the problem suggests that the underlying, true covariance matrix is the Kronecker product of two valid covariance matrices. Examples of such problems are channel modeling for multiple-input multiple-output (MIMO) communications and signal modeling of EEG data. In applications, it may also be that the Kronecker factors in turn can be assumed to possess additional, linear structure. The maximum-likelihood (ML) method for the associated estimation problem has been proposed previously. It is asymptotically efficient but has the drawback of requiring an iterative search for the maximum of the likelihood function. Two methods that are fast and noniterative are proposed in this paper. Both methods are shown to be asymptotically efficient. The first method is a noniterative variant of a well-known alternating maximization technique for the likelihood function. It performs on par with ML in simulations but has the drawback of not allowing for extra structure in addition to the Kronecker structure. The second method is based on covariance matching principles and does not suffer from this drawback. However, while the large sample performance is the same, it performs somewhat worse than the first estimator in small samples. In addition, the Cramer-Rao lower bound for the problem is derived in a compact form. The problem of estimating the Kronecker factors and the problem of detecting if the Kronecker structure is a good model for the covariance matrix of a set of samples are related. Therefore, the problem of detecting the dimensions of the Kronecker factors based on the minimum values of the criterion functions corresponding to the two proposed estimation methods is also treated in this work.

[1]  C. Loan,et al.  Approximation with Kronecker Products , 1992 .

[2]  Björn E. Ottersten,et al.  Covariance Matching Estimation Techniques for Array Signal Processing Applications , 1998, Digit. Signal Process..

[3]  T. W. Anderson An Introduction to Multivariate Statistical Analysis , 1959 .

[4]  Daniel R. Fuhrmann,et al.  Covariance structures for multidimensional data , 1993, Multidimens. Syst. Signal Process..

[5]  Charles R. Johnson,et al.  Topics in Matrix Analysis , 1991 .

[6]  Preben E. Mogensen,et al.  A stochastic MIMO radio channel model with experimental validation , 2002, IEEE J. Sel. Areas Commun..

[7]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[8]  Thomas L. Marzetta,et al.  Parameter estimation problems with singular information matrices , 2001, IEEE Trans. Signal Process..

[9]  D. Zimmerman,et al.  The likelihood ratio test for a separable covariance matrix , 2005 .

[10]  Peter Strobach Low-rank detection of multichannel Gaussian signals using block matrix approximation , 1995, IEEE Trans. Signal Process..

[11]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[12]  Lourens J. Waldorp,et al.  Estimating stationary dipoles from MEG/EEG data contaminated with spatially and temporally correlated background noise , 2001, NeuroImage.

[13]  Bjorn Ottersten,et al.  Maximum likelihood array processing for stochastic coherent sources , 1996, IEEE Trans. Signal Process..

[14]  Per Zetterberg,et al.  Some Notes on the Kronecker Model , 2006 .

[15]  Daniel R. Fuhrmann,et al.  Application of Toeplitz covariance estimation to adaptive beamforming and detection , 1991, IEEE Trans. Signal Process..

[16]  T. Söderström,et al.  On reparametrization of loss functions used in estimation and the invariance principle , 1989 .

[17]  Björn E. Ottersten,et al.  Modeling of wide-band MIMO radio channels based on NLoS indoor measurements , 2004, IEEE Transactions on Vehicular Technology.