A Novel Algorithm for Independent Component Analysis with Reference and Methods for Its Applications

This paper presents a stable and fast algorithm for independent component analysis with reference (ICA-R). This is a technique for incorporating available reference signals into the ICA contrast function so as to form an augmented Lagrangian function under the framework of constrained ICA (cICA). The previous ICA-R algorithm was constructed by solving the optimization problem via a Newton-like learning style. Unfortunately, the slow convergence and potential misconvergence limit the capability of ICA-R. This paper first investigates and probes the flaws of the previous algorithm and then introduces a new stable algorithm with a faster convergence speed. There are two other highlights in this paper: first, new approaches, including the reference deflation technique and a direct way of obtaining references, are introduced to facilitate the application of ICA-R; second, a new method is proposed that the new ICA-R is used to recover the complete underlying sources with new advantages compared with other classical ICA methods. Finally, the experiments on both synthetic and real-world data verify the better performance of the new algorithm over both previous ICA-R and other well-known methods.

[1]  Wei Cheng,et al.  An improved independent component analysis by reference signals and its application on source contribution estimation , 2013, 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[2]  J. Nadal,et al.  Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network 5 , 1994 .

[3]  Yifan Chen,et al.  Microwave breast tumor detection and size estimation using contrast-agent-loaded magnetotactic bacteria , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  Bart De Schutter,et al.  DAISY : A database for identification of systems , 1997 .

[5]  A. J. Bell,et al.  INDEPENDENT COMPONENT ANALYSIS OF BIOMEDICAL SIGNALS , 2000 .

[6]  Christopher J. James,et al.  On the analysis of seizure onset in the EEG: the application of constrained ICA , 2002 .

[7]  Tele Tan,et al.  An improved P300 extraction using ICA-R for P300-BCI speller , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[9]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[10]  Kin-Man Lam,et al.  Depth Estimation of Face Images Based on the Constrained ICA Model , 2010, IEEE Transactions on Information Forensics and Security.

[11]  Sergio Cruces,et al.  From blind signal extraction to blind instantaneous signal separation: criteria, algorithms, and stability , 2004, IEEE Transactions on Neural Networks.

[12]  Nicola Vanello,et al.  Independent component analysis applied to the removal of motion artifacts from electrocardiographic signals , 2008, Medical & Biological Engineering & Computing.

[13]  Shang-Jeng Tsai,et al.  Blind separation with unknown number of sources based on auto-trimmed neural network , 2008, Neurocomputing.

[14]  Robert H. Halstead,et al.  Matrix Computations , 2011, Encyclopedia of Parallel Computing.

[15]  Erkki Oja,et al.  The nonlinear PCA learning rule in independent component analysis , 1997, Neurocomputing.

[16]  M.N.S. Swamy,et al.  Independent Component Analysis , 2014 .

[17]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[18]  Wei Lu,et al.  ICA with Reference , 2006, Neurocomputing.

[19]  Cheng Peng,et al.  Electrogastrogram extraction using independent component analysis with references , 2007, Neural Computing and Applications.

[20]  Erkki Oja,et al.  Efficient Variant of Algorithm FastICA for Independent Component Analysis Attaining the CramÉr-Rao Lower Bound , 2006, IEEE Transactions on Neural Networks.

[21]  Asoke K. Nandi,et al.  Blind Source Separation , 1999 .

[22]  Nathalie Delfosse,et al.  Adaptive separation of independent sources: a deflation approach , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[23]  Vince D. Calhoun,et al.  A fast algorithm for one-unit ICA-R , 2007, Inf. Sci..

[24]  Zhi-Lin Zhang,et al.  Morphologically constrained ICA for extracting weak temporally correlated signals , 2008, Neurocomputing.

[25]  Jean-Franois Cardoso.  High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[26]  G. Skolidis,et al.  Automatic classification of arrhythmic beats using Gaussian Processes , 2008, 2008 Computers in Cardiology.

[27]  Philippe Garat,et al.  Blind separation of mixture of independent sources through a quasi-maximum likelihood approach , 1997, IEEE Trans. Signal Process..

[28]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[29]  Hualou Liang,et al.  Speech Segregation Using Constrained ICA , 2004, ISNN.

[30]  Fuliang Yin,et al.  Advances in Neural Networks – ISNN 2004 , 2004, Lecture Notes in Computer Science.

[31]  P. Tichavský,et al.  Efficient variant of algorithm fastica for independent component analysis attaining the cramer-RAO lower bound , 2005, IEEE/SP 13th Workshop on Statistical Signal Processing, 2005.

[32]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[33]  Christophe Phillips,et al.  Rejection of pulse related artefact (PRA) from continuous electroencephalographic (EEG) time series recorded during functional magnetic resonance imaging (fMRI) using constraint independent component analysis (cICA) , 2009, NeuroImage.

[34]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[35]  Juha Karhunen,et al.  Neural networks for blind separation with unknown number of sources , 1999, Neurocomputing.

[36]  Richard P. Lippmann,et al.  Proceedings of the 1997 conference on Advances in neural information processing systems 10 , 1990 .

[37]  J. Millet-Roig,et al.  Fetal ECG extraction from maternal skin electrodes using blind source separation and adaptive noise cancellation techniques , 2000, Computers in Cardiology 2000. Vol.27 (Cat. 00CH37163).

[38]  M.N.S. Swamy,et al.  Neural Networks and Statistical Learning , 2013 .

[39]  Christopher J. James,et al.  Temporally constrained ICA: an application to artifact rejection in electromagnetic brain signal analysis , 2003, IEEE Transactions on Biomedical Engineering.

[40]  Joseph R. Guerci,et al.  An optimal generalized theory of signal representation , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[41]  Aapo Hyvärinen,et al.  New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit , 1997, NIPS.

[42]  Li Shang,et al.  An improved constrained ICA with reference based unmixing matrix initialization , 2010, Neurocomputing.

[43]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[44]  Dan Hu,et al.  Natural Gradient Flexible ICA Algorithm and Its Application , 2014 .

[45]  Christopher J. James,et al.  ICA with a reference: extracting desired electromagnetic brain signals , 2002 .

[46]  B. Widrow,et al.  Adaptive noise cancelling: Principles and applications , 1975 .

[47]  De-Shuang Huang,et al.  A New Constrained Independent Component Analysis Method , 2007, IEEE Transactions on Neural Networks.

[48]  Wei Lu,et al.  Approach and applications of constrained ICA , 2005, IEEE Transactions on Neural Networks.

[49]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.