Riemannian Geometry and Cramér-rao Bound for Blind Separation of Gaussian Sources

We consider the optimal performance of blind separation of Gaussian sources. In practice, this estimation problem is solved by a two-step procedure: estimation of a set of covariance matrices from the observed data and approximate joint diagonalization of this set to find the unmixing matrix. Rather than studying the theoretical performance of a specific method, we are interested in the optimal attainable performance of any estimator. To do so, we consider the so-called intrinsic Cramér-Rao bound, which exploits the geometry of the parameters of the model. Unlike previous works developing a Cramér-Rao bound in this context, our solution does not require any additional hypotheses. To obtain our bound, we define and study a new Riemannian manifold holding the parameters of interest. An original estimation error measure is defined with the help of our Riemannian distance function. The corresponding Fisher information matrix is then obtained from the Fisher information metric and orthonormal bases on the tangent spaces of the manifold. Finally, our theoretical results are validated on simulated data.

[1]  L. Skovgaard A Riemannian geometry of the multivariate normal model , 1984 .

[2]  Bart Vandereycken,et al.  A Riemannian geometry with complete geodesics for the set of positive semidefinite matrices of fixed rank , 2013 .

[3]  Andreas Ziehe,et al.  A Fast Algorithm for Joint Diagonalization with Non-orthogonal Transformations and its Application to Blind Source Separation , 2004, J. Mach. Learn. Res..

[4]  Hagit Messer,et al.  Second-Order Multidimensional ICA: Performance Analysis , 2012, IEEE Transactions on Signal Processing.

[5]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[6]  P. Tichavsky,et al.  Fast Approximate Joint Diagonalization Incorporating Weight Matrices , 2009, IEEE Transactions on Signal Processing.

[7]  Nicolas Boumal,et al.  On Intrinsic Cramér-Rao Bounds for Riemannian Submanifolds and Quotient Manifolds , 2013, IEEE Transactions on Signal Processing.

[8]  Arie Yeredor,et al.  Blind Separation of Gaussian Sources With General Covariance Structures: Bounds and Optimal Estimation , 2010, IEEE Transactions on Signal Processing.

[9]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[10]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[11]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixtures of nonstationary sources , 2001, IEEE Trans. Signal Process..

[12]  Jonathan H. Manton,et al.  A globally convergent numerical algorithm for computing the centre of mass on compact Lie groups , 2004, ICARCV 2004 8th Control, Automation, Robotics and Vision Conference, 2004..

[13]  H. V. Trees,et al.  Covariance, Subspace, and Intrinsic CramrRao Bounds , 2007 .

[14]  G. Larotonda,et al.  The left invariant metric in the general linear group , 2011, 1109.0520.

[15]  S.T. Smith,et al.  Covariance, subspace, and intrinsic Crame/spl acute/r-Rao bounds , 2005, IEEE Transactions on Signal Processing.

[16]  Hagit Messer,et al.  Blind Separation of Multi-Dimensional Components via Subspace Decomposition: Performance Analysis , 2013, IEEE Transactions on Signal Processing.

[17]  Bijan Afsari,et al.  Sensitivity Analysis for the Problem of Matrix Joint Diagonalization , 2008, SIAM J. Matrix Anal. Appl..

[18]  Marco Congedo,et al.  Riemannian Optimization and Approximate Joint Diagonalization for Blind Source Separation , 2018, IEEE Transactions on Signal Processing.

[19]  Alexandre Renaux,et al.  Intrinsic Cramér–Rao Bounds for Scatter and Shape Matrices Estimation in CES Distributions , 2019, IEEE Signal Processing Letters.

[20]  Marco Congedo,et al.  Diagonality Measures of Hermitian Positive-Definite Matrices with Application to the Approximate Joint Diagonalization Problem , 2016, ArXiv.

[21]  Marco Congedo,et al.  Approximate Joint Diagonalization with Riemannian Optimization on the General Linear Group , 2020, SIAM J. Matrix Anal. Appl..

[22]  Maher Moakher,et al.  To appear in: SIAM J. MATRIX ANAL. APPL. MEANS AND AVERAGING IN THE GROUP OF ROTATIONS∗ , 2002 .