The squared symmetric FastICA estimator

In this paper we study the theoretical properties of the deflation-based FastICA method, the original symmetric FastICA method, and a modified symmetric FastICA method, here called the squared symmetric FastICA. This modification is obtained by replacing the absolute values in the FastICA objective function by their squares. In the deflation-based case this replacement has no effect on the estimate since the maximization problem stays the same. However, in the symmetric case we obtain a different estimate which has been mentioned in the literature, but its theoretical properties have not been studied at all. In the paper we review the classic deflation-based and symmetric FastICA approaches and contrast these with the squared symmetric version of FastICA in a unified way. We find the estimating equations and derive the asymptotical properties of the squared symmetric FastICA estimator with an arbitrary choice of nonlinearity. This allows the main contribution of the paper, i.e., efficiency comparison of the estimates in a wide variety of situations using asymptotic variances of the unmixing matrix estimates. HighlightsThe formal definition of the squared symmetric FastICA estimator is given.The asymptotical properties of the squared symmetric FastICA are derived.Asymptotic variances of different FastICA estimators are compared.

[1]  K. Nordhausen,et al.  Fourth Moments and Independent Component Analysis , 2014, 1406.4765.

[2]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[3]  Pierre Comon,et al.  Comparative Speed Analysis of FastICA , 2007, ICA.

[4]  Klaus Nordhausen,et al.  A New Performance Index for ICA: Properties, Computation and Asymptotic Analysis , 2010, LVA/ICA.

[5]  Tianwen Wei,et al.  An Overview of the Asymptotic Performance of the Family of the FastICA Algorithms , 2015, LVA/ICA.

[6]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[7]  Fabian J. Theis,et al.  A New Concept for Separability Problems in Blind Source Separation , 2004, Neural Computation.

[8]  Tianwen Wei,et al.  A Convergence and Asymptotic Analysis of the Generalized Symmetric FastICA Algorithm , 2014, IEEE Transactions on Signal Processing.

[9]  Tianwen Wei,et al.  On the spurious solutions of the Fastica algorithm , 2014, 2014 IEEE Workshop on Statistical Signal Processing (SSP).

[10]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[11]  Klaus Nordhausen,et al.  Fast equivariant JADE , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[13]  Juha Karhunen,et al.  Advances in Independent Component Analysis and Learning Machines , 2015 .

[14]  Pierre Comon,et al.  How fast is FastICA? , 2006, 2006 14th European Signal Processing Conference.

[15]  Klaus Nordhausen,et al.  Deflation-based FastICA reloaded , 2011, 2011 19th European Signal Processing Conference.

[16]  Yujiro Inoue,et al.  Special Section on Blind Signal Processing : Independent Component Analysis and Signal Separation , 2003 .

[17]  Esa Ollila On the robustness of the deflation-based FastICA estimator , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[18]  P. Tichavský,et al.  Improved variants of the FastICA algorithm , 2015 .

[19]  K. Nordhausen,et al.  Joint Use of Third and Fourth Cumulants in Independent Component Analysis , 2015, 1505.02613.

[20]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[21]  Klaus Nordhausen,et al.  Deflation-Based FastICA With Adaptive Choices of Nonlinearities , 2014, IEEE Transactions on Signal Processing.

[22]  Esa Ollila,et al.  The Deflation-Based FastICA Estimator: Statistical Analysis Revisited , 2010, IEEE Transactions on Signal Processing.

[23]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[24]  A. Hyvärinen,et al.  One-unit contrast functions for independent component analysis: a statistical analysis , 1997 .