Introduction: Independent Component Analysis

Consider a situation in which we have a number of sources emitting signals which are interfering with one another. Familiar situations in which this occurs are a crowded room with many people speaking at the same time, interfering electromagnetic waves from mobile phones or crosstalk from brain waves originating from different areas of the brain. In each of these situations the mixed signals are often incomprehensible and it is of interest to separate the individual signals. This is the goal of Blind Source Separation (BSS). A classic problem in BSS is the cocktail party problem. The objective is to sample a mixture of spoken voices, with a given number of microphones the observations, and then separate each voice into a separate speaker channel -the sources. The BSS is unsupervised and thought of as a black box method. In this we encounter many problems, e.g. time delay between microphones, echo, amplitude difference, voice order in speaker and underdetermined mixture signal.

[1]  Yen-Wei Chen,et al.  Articulated hand tracking by PCA-ICA approach , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[2]  F.C. Morabito,et al.  Neural-ICA and wavelet transform for artifacts removal in surface EMG , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[3]  Marimuthu Palaniswami,et al.  Subtle Hand Gesture Identification for HCI Using Temporal Decorrelation Source Separation BSS of Surface EMG , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[4]  Ella Bingham,et al.  ICA and SOM in text document analysis , 2002, SIGIR '02.

[5]  John D. Enderle,et al.  Introduction to Biomedical Engineering , 1999 .

[6]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[7]  Lai-Wan Chan,et al.  Applying Independent Component Analysis to Factor Model in Finance , 2000, IDEAL.

[8]  Ganesh R. Naik.  Independent Component Analysis for Audio and Biosignal Applications , 2012 .

[9]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[10]  James V. Stone.  Independent Component Analysis: A Tutorial Introduction , 2007 .

[11]  S. Makeig,et al.  Imaging human EEG dynamics using independent component analysis , 2006, Neuroscience & Biobehavioral Reviews.

[12]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[13]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[14]  A. J. Bell,et al.  INDEPENDENT COMPONENT ANALYSIS OF BIOMEDICAL SIGNALS , 2000 .

[15]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[16]  Hagai Attias,et al.  Blind Source Separation and Deconvolution: The Dynamic Component Analysis Algorithm , 1998, Neural Computation.

[17]  Oscar Déniz-Suárez,et al.  Face recognition using independent component analysis and support vector machines , 2001, Pattern Recognit. Lett..

[18]  Jorge Igual,et al.  Application of constrained independent component analysis algorithms in electrocardiogram arrhythmias , 2009, Artif. Intell. Medicine.

[19]  Tülay Adali,et al.  Independent component analysis of 2‐D electrophoresis gels , 2008, Electrophoresis.

[20]  Robert P. W. Duin,et al.  Robust machine fault detection with independent component analysis and support vector data description , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[21]  Yiming Pi,et al.  Applications of ICA for the enhancement and classification of polarimetric SAR images , 2008 .

[22]  Erkki Oja,et al.  A fast algorithm for estimating overcomplete ICA bases for image windows , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[23]  Angelo Ciaramella,et al.  Polarisation analysis of the independent components of low frequency events at Stromboli volcano (Eolian Islands, Italy) , 2004 .

[24]  J.C. Mosher,et al.  Multiple dipole modeling and localization from spatio-temporal MEG data , 1992, IEEE Transactions on Biomedical Engineering.

[25]  J.C. Rajapakse,et al.  Independent component analysis and beyond in brain imaging: EEG, MEG, fMRI, and PET , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[26]  Roger Abächerli,et al.  Independent component analysis-based artefact reduction: application to the electrocardiogram for improved magnetic resonance imaging triggering , 2009, Physiological measurement.

[27]  Qiang Pu,et al.  Short-Text Classification Based on ICA and LSA , 2006, ISNN.

[28]  Manabu Kano,et al.  Monitoring independent components for fault detection , 2003 .

[29]  Chih-Chou Chiu,et al.  Financial time series forecasting using independent component analysis and support vector regression , 2009, Decis. Support Syst..

[30]  R W Prager,et al.  Development of low entropy coding in a recurrent network. , 1996, Network.

[31]  Terrence J. Sejnowski,et al.  Blind source separation of more sources than mixtures using overcomplete representations , 1999, IEEE Signal Processing Letters.

[32]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[33]  B. Olshausen.  Learning linear, sparse, factorial codes , 1996 .

[34]  Chen Jing,et al.  An algorithm of image fusion based on ICA and change detection , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[35]  Allan Kardec Barros,et al.  Application of ICA in the Separation of Breathing Artifacts in ECG Signal , 1998, ICONIP.

[36]  Te-Won Lee,et al.  Independent Component Analysis , 1998, Springer US.

[37]  Xinghua Sun,et al.  A Novel ICA-Based Image/Video Processing Method , 2007, ICA.

[38]  Marimuthu Palaniswami,et al.  Hand gestures for HCI using ICA of EMG , 2006 .

[39]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[40]  Yen-Wei Chen,et al.  Separating Reflections from Images Using Kernel Independent Component Analysis , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[41]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[42]  Christian Jutten,et al.  Space or time adaptive signal processing by neural network models , 1987 .

[43]  M. Coli,et al.  Exploratory analysis of financial time series using independent component analysis , 2005, 27th International Conference on Information Technology Interfaces, 2005..

[44]  Andrzej Cichocki,et al.  Adaptive blind signal and image processing , 2002 .

[45]  Fulei Chu,et al.  Fault recognition method for speed-up and speed-down process of rotating machinery based on independent component analysis and Factorial Hidden Markov Model , 2006 .

[46]  B. De Moor,et al.  ICA algorithms for 3 sources and 2 sensors , 1999, Proceedings of the IEEE Signal Processing Workshop on Higher-Order Statistics. SPW-HOS '99.

[47]  Barak A. Pearlmutter,et al.  Independent Components of Magnetoencephalography: Localization , 2002, Neural Computation.

[48]  Akio Utsugi,et al.  Removal of artifacts and fluctuations from MEG data by clustering methods , 2004, Neurocomputing.

[49]  Edmond H. C. Wu,et al.  Independent Component Analysis for Clustering Multivariate Time Series Data , 2005, ADMA.

[50]  Jaime Parra,et al.  Magnetoencephalography: an investigational tool or a routine clinical technique? , 2004, Epilepsy & Behavior.

[51]  David J. Field,et al.  Sparse Coding of Natural Images Produces Localized, Oriented, Bandpass Receptive Fields , 1995 .

[52]  L. K. Hansen,et al.  Independent Components in Text , 2000 .

[53]  Jong-Hwan Lee,et al.  Application of Independent Component Analysis for the Data Mining of Simultaneous Eeg–fMRI: Preliminary Experience on Sleep Onset , 2009, The International journal of neuroscience.

[54]  M. Scherg,et al.  Two bilateral sources of the late AEP as identified by a spatio-temporal dipole model. , 1985, Electroencephalography and clinical neurophysiology.

[55]  José Millet-Roig,et al.  Atrial activity extraction from atrial fibrillation episodes based on maximum likelihood source separation , 2005, Signal Process..

[56]  Du-Ming Tsai,et al.  An independent component analysis-based filter design for defect detection in low-contrast surface images , 2006, Pattern Recognit..

[57]  Tzyy-Ping Jung,et al.  Noninvasive Study of the Human Heart using Independent Component Analysis , 2006, Sixth IEEE Symposium on BioInformatics and BioEngineering (BIBE'06).

[58]  R. Ilmoniemi,et al.  Magnetoencephalography-theory, instrumentation, and applications to noninvasive studies of the working human brain , 1993 .

[59]  Michalis Zervakis,et al.  The independent components of auditory P300 and CNV evoked potentials derived from single-trial recordings , 2007, Physiological measurement.

[60]  Rainer Goebel,et al.  Classification of fMRI independent components using IC-fingerprints and support vector machine classifiers , 2007, NeuroImage.

[61]  Du-Ming Tsai,et al.  Independent component analysis-based defect detection in patterned liquid crystal display surfaces , 2008, Image Vis. Comput..

[62]  Simone G. O. Fiori,et al.  Overview of independent component analysis technique with an application to synthetic aperture radar (SAR) imagery processing , 2003, Neural Networks.

[63]  Aude Billard,et al.  Recognition and reproduction of gestures using a probabilistic framework combining PCA, ICA and HMM , 2005, ICML.

[64]  Ole Winther,et al.  Mean-Field Approaches to Independent Component Analysis , 2002, Neural Computation.

[65]  John S Denker,et al.  AIP Conference Proceedings 151 on Neural Networks for Computing , 1987 .

[66]  Yannick Deville,et al.  Improvement of remote sensing multispectral image classification by using Independent Component Analysis , 2009, 2009 First Workshop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing.

[67]  Pierre Comon,et al.  Extraction of Atrial Activity from the ECG by Spectrally Constrained ICA Based on Kurtosis Sign , 2007, ICA.

[68]  Juan Manuel Górriz,et al.  An Application of ICA to Identify Vibratory Low-Level Signals Generated by Termites , 2004, ICA.

[69]  Zhang Yan,et al.  Application of Independent Component Analysis to the aero-engine fault diagnosis , 2009, 2009 Chinese Control and Decision Conference.

[70]  Tapani Ristaniemi,et al.  CDMA delay estimation using fast ICA algorithm , 2000, 11th IEEE International Symposium on Personal Indoor and Mobile Radio Communications. PIMRC 2000. Proceedings (Cat. No.00TH8525).

[71]  Terrence J. Sejnowski,et al.  Unsupervised Classification with Non-Gaussian Mixture Models Using ICA , 1998, NIPS.

[72]  Te-Won Lee,et al.  Blind Separation of Delayed and Convolved Sources , 1996, NIPS.

[73]  Jeich Mar,et al.  Combined ICA and FCA Schemes for a Hierarchical Network , 2004, Wirel. Pers. Commun..