A Riemannian Framework for Low-Rank Structured Elliptical Models

This paper proposes an original Riemmanian geometry for low-rank structured elliptical models, i.e., when samples are elliptically distributed with a covariance matrix that has a low-rank plus identity structure. The considered geometry is the one induced by the product of the Stiefel manifold and the manifold of Hermitian positive definite matrices, quotiented by the unitary group. One of the main contribution is to consider an original Riemannian metric, leading to new representations of tangent spaces and geodesics. From this geometry, we derive a new Riemannian optimization framework for robust covariance estimation, which is leveraged to minimize the popular Tyler's cost function on the considered quotient manifold. We also obtain a new divergence function, which is exploited to define a geometrical error measure on the quotient, and the corresponding intrinsic Cramér-Rao lower bound is derived. Thanks to the structure of the chosen parametrization, we further consider the subspace estimation error on the Grassmann manifold and provide its intrinsic Cramér-Rao lower bound. Our theoretical results are illustrated on some numerical experiments, showing the interest of the proposed optimization framework and that performance bounds can be reached.

[1]  Pierre-Antoine Absil,et al.  Quotient Geometry with Simple Geodesics for the Manifold of Fixed-Rank Positive-Semidefinite Matrices , 2020, SIAM J. Matrix Anal. Appl..

[2]  Bamdev Mishra,et al.  Manopt, a matlab toolbox for optimization on manifolds , 2013, J. Mach. Learn. Res..

[3]  Fulvio Gini,et al.  Statistical analysis of measured polarimetric clutter data at different range resolutions , 2006 .

[4]  Alexandre Renaux,et al.  Intrinsic Cramér–Rao Bounds for Scatter and Shape Matrices Estimation in CES Distributions , 2019, IEEE Signal Processing Letters.

[5]  Gilad Lerman,et al.  An Overview of Robust Subspace Recovery , 2018, Proceedings of the IEEE.

[6]  A. Haimovich,et al.  The eigencanceler: adaptive radar by eigenanalysis methods , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Bart Vandereycken,et al.  A Riemannian geometry with complete geodesics for the set of positive semidefinite matrices of fixed rank , 2013 .

[8]  Esa Ollila,et al.  Regularized $M$ -Estimators of Scatter Matrix , 2014, IEEE Transactions on Signal Processing.

[9]  Martin J. Wainwright,et al.  Image denoising using scale mixtures of Gaussians in the wavelet domain , 2003, IEEE Trans. Image Process..

[10]  Philippe Forster,et al.  Performance Analysis of Covariance Matrix Estimates in Impulsive Noise , 2008, IEEE Transactions on Signal Processing.

[11]  Fulvio Gini,et al.  Cramér-Rao Lower Bounds on Covariance Matrix Estimation for Complex Elliptically Symmetric Distributions , 2013, IEEE Transactions on Signal Processing.

[12]  H. V. Trees,et al.  Covariance, Subspace, and Intrinsic CramrRao Bounds , 2007 .

[13]  Steven Kay,et al.  Fundamentals Of Statistical Signal Processing , 2001 .

[14]  Frédéric Pascal,et al.  On the Asymptotics of Maronna's Robust PCA , 2019, IEEE Transactions on Signal Processing.

[15]  David E. Tyler A Distribution-Free $M$-Estimator of Multivariate Scatter , 1987 .

[16]  Thomas L. Marzetta,et al.  A simple derivation of the constrained multiple parameter Cramer-Rao bound , 1993, IEEE Trans. Signal Process..

[17]  Alexandre Renaux,et al.  Statistical analysis of the covariance matrix MLE in K-distributed clutter , 2010, Signal Process..

[18]  D. Ruppert Statistics and Data Analysis for Financial Engineering , 2010 .

[19]  Ivan W. Selesnick,et al.  An elliptically contoured exponential mixture model for wavelet based image denoising , 2007 .

[20]  I. Holopainen Riemannian Geometry , 1927, Nature.

[21]  Silvere Bonnabel,et al.  Riemannian Metric and Geometric Mean for Positive Semidefinite Matrices of Fixed Rank , 2008, SIAM J. Matrix Anal. Appl..

[22]  Olivier Besson,et al.  On the Fisher Information Matrix for Multivariate Elliptically Contoured Distributions , 2013, IEEE Signal Processing Letters.

[23]  B. C. Ng,et al.  On the Cramer-Rao bound under parametric constraints , 1998, IEEE Signal Processing Letters.

[24]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[25]  Muralidhar Rangaswamy,et al.  Robust adaptive signal processing methods for heterogeneous radar clutter scenarios , 2004, Signal Process..

[26]  Silvere Bonnabel,et al.  Regression on Fixed-Rank Positive Semidefinite Matrices: A Riemannian Approach , 2010, J. Mach. Learn. Res..

[27]  Alfred O. Hero,et al.  Lower bounds for parametric estimation with constraints , 1990, IEEE Trans. Inf. Theory.

[28]  K. Fang,et al.  Generalized Multivariate Analysis , 1990 .

[29]  Nicolas Boumal,et al.  On Intrinsic Cramér-Rao Bounds for Riemannian Submanifolds and Quotient Manifolds , 2013, IEEE Transactions on Signal Processing.

[30]  Steeve Zozor,et al.  Some Results on the Denoising Problem in the Elliptically Distributed Context , 2010, IEEE Transactions on Signal Processing.

[31]  Florian Roemer,et al.  Subspace Methods and Exploitation of Special Array Structures , 2014 .

[32]  Ami Wiesel,et al.  Geodesic Convexity and Covariance Estimation , 2012, IEEE Transactions on Signal Processing.

[33]  I. Johnstone On the distribution of the largest eigenvalue in principal components analysis , 2001 .

[34]  P. Absil,et al.  Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation , 2004 .

[35]  Levent Tunçel,et al.  Optimization algorithms on matrix manifolds , 2009, Math. Comput..

[36]  H. Vincent Poor,et al.  Complex Elliptically Symmetric Distributions: Survey, New Results and Applications , 2012, IEEE Transactions on Signal Processing.

[37]  H. Vincent Poor,et al.  Compound-Gaussian Clutter Modeling With an Inverse Gaussian Texture Distribution , 2012, IEEE Signal Processing Letters.

[38]  Nathan A. Goodman,et al.  On Clutter Rank Observed by Arbitrary Arrays , 2007, IEEE Transactions on Signal Processing.

[39]  Martin Bojowald Covariance , 2020, Foundations of Quantum Cosmology.

[40]  Y. Selen,et al.  Model-order selection: a review of information criterion rules , 2004, IEEE Signal Processing Magazine.

[41]  Ami Wiesel,et al.  Unified Framework to Regularized Covariance Estimation in Scaled Gaussian Models , 2012, IEEE Transactions on Signal Processing.

[42]  Prabhu Babu,et al.  Robust Estimation of Structured Covariance Matrix for Heavy-Tailed Elliptical Distributions , 2015, IEEE Transactions on Signal Processing.

[43]  Philippe Forster,et al.  Covariance Structure Maximum-Likelihood Estimates in Compound Gaussian Noise: Existence and Algorithm Analysis , 2008, IEEE Transactions on Signal Processing.

[44]  Vishal Monga,et al.  Rank-Constrained Maximum Likelihood Estimation of Structured Covariance Matrices , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[45]  David E. Tyler,et al.  Geodesic Convexity and Regularized Scatter Estimators , 2016, 1607.05455.

[46]  Philippe Forster,et al.  Asymptotic Properties of Robust Complex Covariance Matrix Estimates , 2012, IEEE Transactions on Signal Processing.

[47]  Stefan Vandewalle,et al.  A Riemannian Optimization Approach for Computing Low-Rank Solutions of Lyapunov Equations , 2010, SIAM J. Matrix Anal. Appl..

[48]  R. Bhatia Positive Definite Matrices , 2007 .

[49]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[50]  V. Yohai,et al.  Robust Estimation of Multivariate Location and Scatter , 2006 .