A robust approach to independent component analysis of signals with high-level noise measurements

We propose a robust approach for independent component analysis (ICA) of signals where observations are contaminated with high-level additive noise and/or outliers. The source signals may contain mixtures of both sub-Gaussian and super-Gaussian components, and the number of sources is unknown. Our robust approach includes two procedures. In the first procedure, a robust prewhitening technique is used to reduce the power of additive noise, the dimensionality and the correlation among sources. A cross-validation technique is introduced to estimate the number of sources in this first procedure. In the second procedure, a nonlinear function is derived using the parameterized t-distribution density model. This nonlinear function is robust against the undue influence of outliers fundamentally. Moreover, the stability of the proposed algorithm and the robust property of misestimating the parameters (kurtosis) have been studied. By combining the t-distribution model with a family of light-tailed distributions (sub-Gaussian) model, we can separate the mixture of sub-Gaussian and super-Gaussian source components. Through the analysis of artificially synthesized data and real-world magnetoencephalographic (MEG) data, we illustrate the efficacy of this robust approach.

[1]  Andrzej Cichocki,et al.  Independent component analysis for unaveraged single-trial MEG data decomposition and single-dipole source localization , 2002, Neurocomputing.

[2]  Tsunehiro Takeda,et al.  Single-Trial Magnetoencephalographic Data Decomposition and Localization Based on Independent Component Analysis Approach , 2000 .

[3]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[4]  Noboru Murata,et al.  A stable and robust ICA algorithm based on t-distribution and generalized Gaussian distribution models , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[5]  Shun-ichi Amari,et al.  Natural Gradient Learning for Over- and Under-Complete Bases in ICA , 1999, Neural Computation.

[6]  Aapo Hyvärinen,et al.  Gaussian moments for noisy independent component analysis , 1999, IEEE Signal Processing Letters.

[7]  Hagai Attias,et al.  Independent Factor Analysis , 1999, Neural Computation.

[8]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[9]  Juha Karhunen,et al.  Neural networks for blind separation with unknown number of sources , 1999, Neurocomputing.

[10]  Aapo Hyvärinen,et al.  Independent component analysis in the presence of Gaussian noise by maximizing joint likelihood , 1998, Neurocomputing.

[11]  Andrzej Cichocki,et al.  Robust techniques for independent component analysis (ICA) with noisy data , 1998, Neurocomputing.

[12]  Andrzej Cichocki,et al.  Bias removal technique for blind source separation with noisy measurements , 1998 .

[13]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[14]  Shun-ichi Amari,et al.  Blind source separation-semiparametric statistical approach , 1997, IEEE Trans. Signal Process..

[15]  Andrzej Cichocki,et al.  Stability Analysis of Learning Algorithms for Blind Source Separation , 1997, Neural Networks.

[16]  S. Amari,et al.  Multichannel blind separation and deconvolution of sources with arbitrary distributions , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[17]  Jean-François Cardoso,et al.  Equivariant adaptive source separation , 1996, IEEE Trans. Signal Process..

[18]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[19]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[20]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[21]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[22]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[23]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[24]  Wojtek J. Krzanowski,et al.  Cross-Validation in Principal Component Analysis , 1987 .

[25]  Deniz Erdogmus,et al.  Information Theoretic Learning , 2005, Encyclopedia of Artificial Intelligence.

[26]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[27]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[28]  S. Ikeda,et al.  ICA on Noisy Data: A Factor Analysis Approach , 2000 .

[29]  Marissa Westerfield,et al.  INDEPENDENT COMPONENT ANALYSIS OF SINGLE-TRIAL EVENT-RELATED POTENTIALS , 1999 .

[30]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources , 1999, Neural Comput..

[31]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[32]  Shun-ichi Amari,et al.  Stability Analysis Of Adaptive Blind Source Separation , 1997 .

[33]  M. Girolami.  Negentropy and Kurtosis as Projection Pursuit Indices Provide Generalised ICA Algorithms , 1996, NIPS 1996.

[34]  Antoine Souloumiac,et al.  Jacobi Angles for Simultaneous Diagonalization , 1996, SIAM J. Matrix Anal. Appl..

[35]  Signal Processing , 1991 .