Analyzing consistency of independent components: An fMRI illustration

Independent component analysis (ICA) is a powerful data-driven signal processing technique. It has proved to be helpful in, e.g., biomedicine, telecommunication, finance and machine vision. Yet, some problems persist in its wider use. One concern is the reliability of solutions found with ICA algorithms, resulting from the stochastic changes each time the analysis is performed. The consistency of the solutions can be analyzed by clustering solutions from multiple runs of bootstrapped ICA. Related methods have been recently published either for analyzing algorithmic stability or reducing the variability. The presented approach targets the extraction of additional information related to the independent components, by focusing on the nature of the variability. Practical implications are illustrated through a functional magnetic resonance imaging (fMRI) experiment.

[1]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[2]  I. Jolliffe.  Principal Component Analysis , 2002 .

[3]  Aapo Hyvrinen,et al.  Fast and Robust Fixed-Point Algorithms , 1999 .

[4]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[5]  R Baumgartner,et al.  Resampling as a cluster validation technique in fMRI , 2000, Journal of magnetic resonance imaging : JMRI.

[6]  Vince D. Calhoun,et al.  ICA of functional MRI data: an overview. , 2003 .

[7]  Ho-Young Jung,et al.  Speech feature extraction using independent component analysis , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[8]  Michael Breakspear,et al.  Spatiotemporal wavelet resampling for functional neuroimaging data , 2004, Human brain mapping.

[9]  Massimiliano Pontil,et al.  A Simple Algorithm for Learning Stable Machines , 2002, ECAI.

[10]  Joachim M. Buhmann,et al.  Stability-Based Validation of Clustering Solutions , 2004, Neural Computation.

[11]  Antti Tarkiainen,et al.  Brains and Phantoms: An ICA Study of fMRI , 2006, ICA.

[12]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[13]  Motoaki Kawanabe,et al.  A resampling approach to estimate the stability of one-dimensional or multidimensional independent components , 2002, IEEE Transactions on Biomedical Engineering.

[14]  Jean-Francois Cardoso,et al.  Eigen-structure of the fourth-order cumulant tensor with application to the blind source separation problem , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[15]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[16]  Barak A. Pearlmutter,et al.  Independent Components of Magnetoencephalography: Localization , 2002, Neural Computation.

[17]  E. Oja,et al.  Independent Component Analysis , 2013 .

[18]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[19]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[20]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[21]  T. Sejnowski,et al.  Independent component analysis of fMRI data: Examining the assumptions , 1998, Human brain mapping.

[22]  D. Rubin.  The Bayesian Bootstrap , 1981 .

[23]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[24]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[25]  Jarkko Ylipaavalniemi,et al.  Subspaces of Spatially Varying Independent Components in fMRI , 2007, ICA.

[26]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[27]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[28]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[29]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[30]  Klaus-Robert Müller,et al.  Injecting noise for analysing the stability of ICA components , 2004, Signal Process..

[31]  Ricardo Vig.  Overlearning in Marginal Distribution-Based ICA: Analysis and Solutions , 2003 .

[32]  J. Ylipaavalniemi,et al.  Analysis of auditory fMRI recordings via ICA: a study on consistency , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[33]  E. Formisano,et al.  Functional connectivity as revealed by spatial independent component analysis of fMRI measurements during rest , 2004, Human brain mapping.

[34]  J. Cardoso.  Blind Identification Of Independent Components With Higher-order Statistics , 1989, Workshop on Higher-Order Spectral Analysis.

[35]  P O Hoyer,et al.  Independent component analysis applied to feature extraction from colour and stereo images , 2000, Network.

[36]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[37]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[38]  T. Sejnowski,et al.  CONSISTENCY OF INFOMAX ICA DECOMPOSITION OF FUNCTIONAL BRAIN IMAGING DATA , 2003 .

[39]  Herbert Lee,et al.  Bagging and the Bayesian Bootstrap , 2001, AISTATS.

[40]  Erkki Oja,et al.  Image Feature Extraction Using Independent Component Analysis , 1996 .

[41]  L. K. Hansen,et al.  Independent component analysis of functional MRI: what is signal and what is noise? , 2003, Current Opinion in Neurobiology.

[42]  N. Murata,et al.  AN APPROACH OF GROUPING DECOMPOSED COMPONENTS , 2003 .

[43]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[44]  Erkki Oja,et al.  Independent component analysis for artefact separation in astrophysical images , 2003, Neural Networks.

[45]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[46]  Ricardo Vigário,et al.  Overlearning in Marginal Distribution-Based ICA: Analysis and Solutions , 2003, J. Mach. Learn. Res..

[47]  Yuanqing Li,et al.  Analysis of Sparse Representation and Blind Source Separation , 2004, Neural Computation.

[48]  Jianbo Shi,et al.  A Random Walks View of Spectral Segmentation , 2001, AISTATS.

[49]  Stefan Harmeling,et al.  ANALYSING ICA COMPONENTS BY INJECTING NOISE , 2003 .

[50]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[51]  Robert Tibshirani,et al.  The out-of-bootstrap method for model averaging and selection , 1997 .

[52]  Alexander Kraskov,et al.  Reliability of ICA Estimates with Mutual Information , 2004, ICA.

[53]  J. Pekar,et al.  fMRI Activation in a Visual-Perception Task: Network of Areas Detected Using the General Linear Model and Independent Components Analysis , 2001, NeuroImage.

[54]  Jianbo Shi,et al.  Learning Segmentation by Random Walks , 2000, NIPS.

[55]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[56]  L. K. Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.