Independent component analysis: An introduction

Abstract Independent component analysis (ICA) is a widely-used blind source separation technique. ICA has been applied to many applications. ICA is usually utilized as a black box, without understanding its internal details. Therefore, in this paper, the basics of ICA are provided to show how it works to serve as a comprehensive source for researchers who are interested in this field. This paper starts by introducing the definition and underlying principles of ICA. Additionally, different numerical examples in a step-by-step approach are demonstrated to explain the preprocessing steps of ICA and the mixing and unmixing processes in ICA. Moreover, different ICA algorithms, challenges, and applications are presented.

[1]  Michael S. Lewicki,et al.  Unsupervised image classification, segmentation, and enhancement using ICA mixture models , 2002, IEEE Trans. Image Process..

[2]  Sylvain Chartier,et al.  An Introduction to Independent Component Analysis: InfoMax and FastICA algorithms , 2010 .

[3]  Vince D. Calhoun,et al.  A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data , 2009, NeuroImage.

[4]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[5]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[6]  Volkan Cevher,et al.  Computational methods for underdetermined convolutive speech localization and separation via model-based sparse component analysis , 2016, Speech Commun..

[7]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Bin Kong,et al.  Independent component analysis and its application in the fingerprint image preprocessing , 2004, International Conference on Information Acquisition, 2004. Proceedings..

[9]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[10]  Ying Nian Wu,et al.  Decoding the encoding of functional brain networks: An fMRI classification comparison of non-negative matrix factorization (NMF), independent component analysis (ICA), and sparse coding algorithms , 2016, Journal of Neuroscience Methods.

[11]  Aapo Hyvärinen,et al.  A Linear Non-Gaussian Acyclic Model for Causal Discovery , 2006, J. Mach. Learn. Res..

[12]  John W. Tukey,et al.  A Projection Pursuit Algorithm for Exploratory Data Analysis , 1974, IEEE Transactions on Computers.

[13]  Aapo Hyvärinen,et al.  Independent component analysis in the presence of Gaussian noise by maximizing joint likelihood , 1998, Neurocomputing.

[14]  Clemens Brunner,et al.  Variability of ICA decomposition may impact EEG signals when used to remove eyeblink artifacts. , 2017, Psychophysiology.

[15]  Aapo Hyvärinen,et al.  New Approximations of Differential Entropy for Independent Component Analysis and Projection Pursuit , 1997, NIPS.

[16]  Jonathon Shlens,et al.  A Tutorial on Independent Component Analysis , 2014, ArXiv.

[17]  Ji-Won Cho,et al.  Independent vector analysis followed by HMM-based feature enhancement for robust speech recognition , 2016, Signal Process..

[18]  Barak A. Pearlmutter,et al.  Maximum Likelihood Blind Source Separation: A Context-Sensitive Generalization of ICA , 1996, NIPS.

[19]  Aapo Hyvärinen,et al.  Gaussian moments for noisy independent component analysis , 1999, IEEE Signal Processing Letters.

[20]  Namita Srivastava,et al.  A fuzzy based feature selection from independent component subspace for machine learning classification of microarray data , 2016, Genomics data.

[21]  Rifai Chai,et al.  Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System , 2017, IEEE Journal of Biomedical and Health Informatics.

[22]  Terrence J. Sejnowski,et al.  Learning Overcomplete Representations , 2000, Neural Computation.

[23]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[24]  Zhi-Chun Mu,et al.  A novel approach for ear recognition based on ICA and RBF network , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[25]  J. Cardoso.  Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[26]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[27]  Issam Dagher,et al.  Face recognition using IPCA-ICA algorithm , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[29]  Alaa Tharwat.  Principal component analysis - a tutorial , 2016, Int. J. Appl. Pattern Recognit..

[30]  Shun-ichi Amari,et al.  Natural Gradient Learning for Over- and Under-Complete Bases in ICA , 1999, Neural Computation.

[31]  Nathalie Delfosse,et al.  Adaptive blind separation of independent sources: A deflation approach , 1995, Signal Process..

[32]  Stéphane Derrode,et al.  Unsupervised multicomponent image segmentation combining a vectorial HMC model and ICA , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).