Sequential Fixed-Point ICA Based on Mutual Information Minimization

A new gradient technique is introduced for linear independent component analysis (ICA) based on the Edgeworth expansion of mutual information, for which the algorithm operates sequentially using fixed-point iterations. In order to address the adverse effect of outliers, a robust version of the Edgeworth expansion is adopted, in terms of robust cumulants, and robust derivatives of the Hermite polynomials are used. Also, a new constrained version of ICA is introduced, based on goal programming of mutual information objectives, which is applied to the extraction of the antepartum fetal electrocardiogram from multielectrode cutaneous recordings on the mother's thorax and abdomen.

[1]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources , 1999, Neural Comput..

[2]  Visa Koivunen,et al.  Pearson System based Method for Blind Separation , 2000 .

[3]  Robert Tibshirani,et al.  Independent Components Analysis through Product Density Estimation , 2002, NIPS.

[4]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[5]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  O. Barndorff-Nielsen,et al.  Absolute Moments of Generalized Hyperbolic Distributions and Approximate Scaling of Normal Inverse Gaussian Lévy Processes , 2005 .

[8]  Max Welling,et al.  Robust Series Expansionsfor Probability Density EstimationMax WellingDept , 2022 .

[9]  Aapo Hyv.  Fast and Robust Fixed-Point Algorithms for Independent Component Analysis , 1999 .

[10]  Shun-ichi Amari,et al.  Adaptive Online Learning Algorithms for Blind Separation: Maximum Entropy and Minimum Mutual Information , 1997, Neural Computation.

[11]  A. Kraskov,et al.  Estimating mutual information. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[12]  Bo Hu,et al.  Principal independent component analysis , 1999, IEEE Trans. Neural Networks.

[13]  D. Cox,et al.  Inference and Asymptotics , 1994 .

[14]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[15]  Frederick S. Hillier,et al.  Introduction of Operations Research , 1967 .

[16]  Juha Karhunen,et al.  Generalizing Independent Component Analysis for Two Related Data Sets , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[17]  Joos Vandewalle,et al.  Fetal electrocardiogram extraction by blind source subspace separation , 2000, IEEE Transactions on Biomedical Engineering.

[18]  Visa Koivunen,et al.  Source Distribution Adaptive Maximum Likelihood Estimation of ICA Model , 2000 .

[19]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction , 2001 .

[20]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[21]  Aapo Hyvärinen,et al.  New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit , 1997, NIPS.

[22]  Frederick S. Hillier,et al.  Introduction of Operations Research , 1967 .

[23]  L. Carin,et al.  A new algorithm for independent component analysis with or without constraints , 2002, Sensor Array and Multichannel Signal Processing Workshop Proceedings, 2002.

[24]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[25]  Gene H. Golub,et al.  Matrix computations , 1983 .

[26]  Dinh Tuan Pham,et al.  Separation of a mixture of independent sources through a maximum likelihood approach , 1992 .

[27]  Wei Lu,et al.  ICA with Reference , 2006, Neurocomputing.

[28]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[29]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[30]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[31]  Laurenz Wiskott,et al.  An Improved Cumulant Based Method for Independent Component Analysis , 2002, ICANN.

[32]  Christopher J. James,et al.  Temporally constrained ICA: an application to artifact rejection in electromagnetic brain signal analysis , 2003, IEEE Transactions on Biomedical Engineering.

[33]  Jean-Franois Cardoso.  High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[34]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[35]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[36]  Frederick S. Hillier,et al.  Introduction to Operations Research (Second Edition) , 1976 .

[37]  T. Rao,et al.  Tensor Methods in Statistics , 1989 .