Optimal Pairwise Fourth-Order Independent Component Analysis

Blind source separation (BSS) aims at the reconstruction of unknown mutually independent signals, so-called sources, from their mixtures observed at the output of a sensor array. The BSS of instantaneous linear mixtures, which finds application in numerous fields, can be solved through the statistical tool of independent component analysis (ICA). This paper concentrates on the analytic solutions for the fundamental two-signal ICA scenario. A novel estimation class, so-called general weighted fourth-order estimator (GWFOE), is put forward, which is based on the fourth-order statistics of the whitened sensor output. By means of a weight parameter, the GWFOE is able to unify a variety of apparently disparate estimation expressions previously scattered throughout the literature, including the well-known JADE method in the two-signal case. A theoretical asymptotic performance analysis is carried out, resulting in the GWFOE large-sample mean square error and the source-dependent weight value of the most efficient estimator in the class. To extend the pairwise estimators to the general scenario of more than two sources, an improved Jacobi-like optimization technique is proposed. The approach consists of calculating the necessary sensor-output fourth-order statistics at the initialization stage of the algorithm, which can lead to significant computational savings when large sample blocks are processed. Based on this idea, adaptive algorithms are also devised, showing very satisfactory convergence characteristics. Experiments illustrate the good performance of these optimal pairwise ICA strategies, in both off- and on-line processing modes

[1]  Erkki Oja,et al.  An Experimental Comparison of Neural ICA Algorithms , 1998 .

[2]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[3]  Asoke K. Nandi,et al.  Adaptive blind source separation for virtually any source probability density function , 2000, IEEE Trans. Signal Process..

[4]  M. Kendall,et al.  Kendall's advanced theory of statistics , 1995 .

[5]  A. Swami,et al.  Approximate maximum likelihood blind source separation with arbitrary source PDFs , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[6]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[7]  Fabian J. Theis,et al.  A New Concept for Separability Problems in Blind Source Separation , 2004, Neural Computation.

[8]  Terrence J. Sejnowski,et al.  Unsupervised Classification with Non-Gaussian Mixture Models Using ICA , 1998, NIPS.

[9]  Laurenz Wiskott,et al.  CuBICA: independent component analysis by simultaneous third- and fourth-order cumulant diagonalization , 2004, IEEE Transactions on Signal Processing.

[10]  V. Zarzoso,et al.  Weighted closed-form estimators for blind source separation , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[11]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[12]  P. Comon Separation Of Stochastic Processes , 1989, Workshop on Higher-Order Spectral Analysis.

[13]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[14]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[15]  Jean-Franois Cardoso High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[16]  Asoke K. Nandi,et al.  Combined estimation scheme for blind source separation with arbitrary source PDFs , 2001 .

[17]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[19]  Gene H. Golub,et al.  Matrix computations (3rd ed.) , 1996 .

[20]  Visa Koivunen,et al.  Characteristic-function-based independent component analysis , 2003, Signal Process..

[21]  Pierre Priouret,et al.  Adaptive Algorithms and Stochastic Approximations , 1990, Applications of Mathematics.

[22]  Pierre Comon,et al.  Improved contrast dedicated to blind separation in communications , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[23]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[24]  Juan José Murillo-Fuentes,et al.  A sinusoidal contrast function for the blind separation of statistically independent sources , 2004, IEEE Transactions on Signal Processing.

[25]  Arie Yeredor,et al.  Non-orthogonal joint diagonalization in the least-squares sense with application in blind source separation , 2002, IEEE Trans. Signal Process..

[26]  Rafael Boloix-Tortosa,et al.  INITIALIZED JACOBI OPTIMIZATION IN INDEPENDENT COMPONENT ANALYSIS , 2003 .

[27]  Juan José Murillo-Fuentes,et al.  Hybrid higher-order statistics learning in multiuser detection , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Eric Moreau,et al.  High order contrasts for self-adaptive source separation criteria for complex source separation , 1996 .

[29]  J. J. Murillo-Fuentes,et al.  ADAPTIVE INITIALIZED JACOBI OPTIMIZATION IN INDEPENDENT COMPONENT ANALYSIS , 2003 .

[30]  Ira J. Clarke Direct exploitation of non-Gaussianity as a discriminant , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[31]  Jean-Louis Lacoume,et al.  Maximum likelihood estimators and Cramer-Rao bounds in source separation , 1996, Signal Process..

[32]  Juan José Murillo-Fuentes,et al.  Independent component analysis applied to digital image watermarking , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[33]  A. Bunse-Gerstner,et al.  Numerical Methods for Simultaneous Diagonalization , 1993, SIAM J. Matrix Anal. Appl..

[34]  Asoke K. Nandi,et al.  Blind separation of independent sources for virtually any source probability density function , 1999, IEEE Trans. Signal Process..

[35]  Asoke K. Nandi,et al.  Blind Source Separation , 1999 .

[36]  Asoke K. Nandi,et al.  Blind separation of linear instantaneous mixtures using closed-form estimators , 2001, Signal Process..

[37]  Remarques sur la diagonalisation tensorielle par la méthode de Jacobi , 1993 .

[38]  J. J. Murillo-Fuentes,et al.  Independent component analysis based on marginal entropy approximations , 2004, Proceedings World Automation Congress, 2004..

[39]  Asoke K. Nandi,et al.  Noninvasive fetal electrocardiogram extraction: blind separation versus adaptive noise cancellation , 2001, IEEE Transactions on Biomedical Engineering.

[40]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[41]  Juan José Murillo-Fuentes,et al.  Independent component analysis with sinusoidal fourth-order contrasts , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).