The Deflation-Based FastICA Estimator: Statistical Analysis Revisited

This paper provides a rigorous statistical analysis of the deflation-based FastICA estimator, where the independent components (ICs) are extracted sequentially. The focus is on two aspects of the estimator: robustness against outliers as measured by the influence function (IF) and on its asymptotic relative efficiency (ARE) as measured by the ratio of the asymptotic variance of the FastICA w.r.t. the optimal maximum likelihood estimator (MLE). The derived compact closed-form expression of the IF reveals the vulnerability of the FastICA estimator to outliers regardless of the used nonlinearity. A cautionary finding is that even a moderate observation towards certain directions can render the estimator deficient in the sense that its separation performance degrades worse than a plain guess. The IF allows the derivation of a compact closed-form expression for the asymptotic covariance matrix of the FastICA estimator and subsequently its asymptotic relative efficiencies (AREs). The ARE figures calculated for some selected source distributions illustrate the fact that the order which the ICs are found is crucial as the accuracy of the previously extracted components can dominantly affect the accuracy of the successive deflation stages.

[1]  C. Croux Limit behavior of the empirical influence function of the median , 1998 .

[2]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[3]  V. Yohai,et al.  Robust Statistics: Theory and Methods , 2006 .

[4]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[5]  Jean-Christophe Pesquet,et al.  Convolutive Blind Signal Separation Based on Asymmetrical Contrast Functions , 2007, IEEE Transactions on Signal Processing.

[6]  Mia Hubert,et al.  A robustification of independent component analysis , 2005 .

[7]  E. Oja,et al.  Performance Analysis of the FastICA Algorithm and Cramér – Rao Bounds for Linear Independent Component Analysis , 2010 .

[8]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[9]  A. Hyvärinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997 .

[10]  Scott C. Douglas,et al.  Fixed-Point Algorithms for the Blind Separation of Arbitrary Complex-Valued Non-Gaussian Signal Mixtures , 2007, EURASIP J. Adv. Signal Process..

[11]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[12]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[13]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[14]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[15]  Alle-Jan van der Veen,et al.  Blind Source Separation: The Location of Local Minima in the Case of Finitely Many Samples , 2008, IEEE Transactions on Signal Processing.

[16]  Hannu Oja,et al.  Complex-valued ICA based on a pair of generalized covariance matrices , 2008, Comput. Stat. Data Anal..

[17]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[18]  Godfrey D Pearlson,et al.  Source density‐driven independent component analysis approach for fMRI data , 2005, Human brain mapping.

[19]  Visa Koivunen,et al.  Identifiability, separability, and uniqueness of linear ICA models , 2004, IEEE Signal Processing Letters.

[20]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[21]  D. Ruppert Robust Statistics: The Approach Based on Influence Functions , 1987 .

[22]  Visa Koivunen,et al.  Compact CramÉr–Rao Bound Expression for Independent Component Analysis , 2008, IEEE Transactions on Signal Processing.

[23]  Aapo Hyvärinen,et al.  Testing Significance of Mixing and Demixing Coefficients in ICA , 2006, ICA.

[24]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[25]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.