Compact CramÉr–Rao Bound Expression for Independent Component Analysis

Despite of the increased interest in independent component analysis (ICA) during the past two decades, a simple closed form expression of the Cramer-Rao bound (CRB) for the demixing matrix estimation has not been established in the open literature. In the present paper we fill this gap by deriving a simple closed-form expression for the CRB of the demixing matrix directly from its definition. A simulation study comparing ICA estimators with the CRB is given.

[1]  A. Hyvärinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997 .

[2]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources based on order statistics , 2000, IEEE Trans. Signal Process..

[3]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[4]  Daniel Yellin,et al.  Multichannel system identification and deconvolution: performance bounds , 1999, IEEE Trans. Signal Process..

[5]  Arie Yeredor,et al.  Cramér–Rao-Induced Bound for Blind Separation of Stationary Parametric Gaussian Sources , 2007, IEEE Signal Processing Letters.

[6]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[7]  Dinh-Tuan Pham,et al.  Blind separation of instantaneous mixture of sources via an independent component analysis , 1996, IEEE Trans. Signal Process..

[8]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[9]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[10]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[11]  P. Bickel,et al.  Mathematical Statistics: Basic Ideas and Selected Topics , 1977 .

[12]  E. Oja,et al.  Performance Analysis of the FastICA Algorithm and Cramér – Rao Bounds for Linear Independent Component Analysis , 2010 .

[13]  Arie Yeredor,et al.  A blind-ML scheme for blind source separation , 2004, IEEE Workshop on Statistical Signal Processing, 2003.

[14]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[15]  Ehud Weinstein,et al.  Maximum likelihood and lower bounds in system identification with non-Gaussian inputs , 1994, IEEE Trans. Inf. Theory.

[16]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[17]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[18]  Christian Jutten,et al.  Fisher Information in Source Separation Problems , 2004, ICA.

[19]  Visa Koivunen,et al.  Identifiability, separability, and uniqueness of linear ICA models , 2004, IEEE Signal Processing Letters.