Data-driven Analysis for Natural Studies in Functional Brain Imaging

Aalto University, P.O. Box 11000, FI-00076 Aalto www.aalto.fi Author Jarkko Ylipaavalniemi Name of the doctoral dissertation Data-driven Analysis for Natural Studies in Functional Brain Imaging Publisher School of Science Unit Department of Information and Computer Science Series Aalto University publication series DOCTORAL DISSERTATIONS 70/2013 Field of research Computer and Information Science Manuscript submitted 5 November 2012 Date of the defence 3 May 2013 Permission to publish granted (date) 20 December 2012 Language English Monograph Article dissertation (summary + original articles) Abstract In neuroscience, functional magnetic resonance imaging (fMRI) has become a powerful tool in human brain mapping. Typically, fMRI is used with a rather simple stimulus sequence, aiming at improving signal-to-noise ratio for statistical hypothesis testing. When natural stimuli are used, the simple designs are no longer appropriate. The aim of this thesis is in developing data-driven approaches for reliable inference of brain correlates to natural stimuli. Since the beginning of the nineteenth century, neuroscience has focused on the idea that distinct regions of the brain support particular mental processes. However, modern research recognizes that many functions rely on distributed networks, and that a single brain region may participate in more than one function. These rapid paradigm changes in neuroscience raise important methodological challenges. Purely hypothesis-driven methods have been used extensively in functional imaging studies. As the focus in brain research is shifting away from functional specialization towards interaction-based functional networks, those approaches are no longer appropriate. In contrast to the classic statistical hypothesis testing approaches, modern machine learning methods allow for a purely data-driven way to describe the data. They do not use the stimuli, and make no assumptions about whether the brain processes are stimulus related or not. The recordings for each brain region may contain a complicated mixture of activity, which is produced by many spatially distributed processes, and artifacts. Each process can be described as a component having a separate time series and spatial extent, and producing simultaneous changes in the fMRI signals of many regions. The main contribution of the thesis is a reliable independent component analysis (ICA) approach, which is available in the Arabica toolbox. The usefulness of the approach was tested extensively with fMRI data, showing that the method is capable of providing insights into the data that would not be attainable otherwise. The new method was also theoretically analyzed and its asymptotic convergence was proven. The theory offers a thorough explanation of how the method works and justifies its use in practice. Then, the new method is further developed for analyzing networks of distributed brain activity, by combining it with canonical correlation analysis (CCA). The extension was shown to be particularly useful with fMRI studies that use natural stimuli. The approach is further extended to be applicable in cases where independent subspaces emerge, which often happens when using real measurement data that is not guaranteed to fit all the assumptions made in the development of the methods.In neuroscience, functional magnetic resonance imaging (fMRI) has become a powerful tool in human brain mapping. Typically, fMRI is used with a rather simple stimulus sequence, aiming at improving signal-to-noise ratio for statistical hypothesis testing. When natural stimuli are used, the simple designs are no longer appropriate. The aim of this thesis is in developing data-driven approaches for reliable inference of brain correlates to natural stimuli. Since the beginning of the nineteenth century, neuroscience has focused on the idea that distinct regions of the brain support particular mental processes. However, modern research recognizes that many functions rely on distributed networks, and that a single brain region may participate in more than one function. These rapid paradigm changes in neuroscience raise important methodological challenges. Purely hypothesis-driven methods have been used extensively in functional imaging studies. As the focus in brain research is shifting away from functional specialization towards interaction-based functional networks, those approaches are no longer appropriate. In contrast to the classic statistical hypothesis testing approaches, modern machine learning methods allow for a purely data-driven way to describe the data. They do not use the stimuli, and make no assumptions about whether the brain processes are stimulus related or not. The recordings for each brain region may contain a complicated mixture of activity, which is produced by many spatially distributed processes, and artifacts. Each process can be described as a component having a separate time series and spatial extent, and producing simultaneous changes in the fMRI signals of many regions. The main contribution of the thesis is a reliable independent component analysis (ICA) approach, which is available in the Arabica toolbox. The usefulness of the approach was tested extensively with fMRI data, showing that the method is capable of providing insights into the data that would not be attainable otherwise. The new method was also theoretically analyzed and its asymptotic convergence was proven. The theory offers a thorough explanation of how the method works and justifies its use in practice. Then, the new method is further developed for analyzing networks of distributed brain activity, by combining it with canonical correlation analysis (CCA). The extension was shown to be particularly useful with fMRI studies that use natural stimuli. The approach is further extended to be applicable in cases where independent subspaces emerge, which often happens when using real measurement data that is not guaranteed to fit all the assumptions made in the development of the methods.

[1]  L. K. Hansen,et al.  The Quantitative Evaluation of Functional Neuroimaging Experiments: The NPAIRS Data Analysis Framework , 2000, NeuroImage.

[2]  Janaina Mourão Miranda,et al.  Unsupervised analysis of fMRI data using kernel canonical correlation , 2007, NeuroImage.

[3]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[4]  Karl J. Friston,et al.  Statistical parametric mapping , 2013 .

[5]  Barak A. Pearlmutter,et al.  Independent Components of Magnetoencephalography: Localization , 2002, Neural Computation.

[6]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[7]  Anja Vogler,et al.  An Introduction to Multivariate Statistical Analysis , 2004 .

[8]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[9]  J R Moeller,et al.  A Regional Covariance Approach to the Analysis of Functional Patterns in Positron Emission Tomographic Data , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[10]  T. Sejnowski,et al.  Human Brain Mapping 6:368–372(1998) � Independent Component Analysis of fMRI Data: Examining the Assumptions , 2022 .

[11]  Erkki Oja,et al.  Performance analysis of the FastICA algorithm and Crame/spl acute/r-rao bounds for linear independent component analysis , 2006, IEEE Transactions on Signal Processing.

[12]  Karl Pearson F.R.S. LIII. On lines and planes of closest fit to systems of points in space , 1901 .

[13]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[14]  Anthony Randal McIntosh,et al.  Towards a network theory of cognition , 2000, Neural Networks.

[15]  L. K. Hansen,et al.  Independent component analysis of functional MRI: what is signal and what is noise? , 2003, Current Opinion in Neurobiology.

[16]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited—Again , 1995, NeuroImage.

[17]  Abraham Z. Snyder,et al.  A default mode of brain function: A brief history of an evolving idea , 2007, NeuroImage.

[18]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[19]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[20]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .

[21]  Erkki Oja,et al.  Independent component approach to the analysis of EEG and MEG recordings , 2000, IEEE Transactions on Biomedical Engineering.

[22]  L. Shah,et al.  Functional magnetic resonance imaging. , 2010, Seminars in roentgenology.

[23]  Aapo Hyvärinen,et al.  Topographic Independent Component Analysis , 2001, Neural Computation.

[24]  Klaus-Robert Müller,et al.  Injecting noise for analysing the stability of ICA components , 2004, Signal Process..

[25]  M. Corbetta,et al.  Electrophysiological signatures of resting state networks in the human brain , 2007, Proceedings of the National Academy of Sciences.

[26]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[27]  J. Gallant,et al.  Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies , 2011, Current Biology.

[28]  Jianbo Shi,et al.  Learning Segmentation by Random Walks , 2000, NIPS.

[29]  Jean-Francois Cardoso,et al.  Eigen-structure of the fourth-order cumulant tensor with application to the blind source separation problem , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[30]  R. Hari,et al.  The opponent matters: elevated FMRI reward responses to winning against a human versus a computer opponent during interactive video game playing. , 2013, Cerebral cortex.

[31]  Fabian J. Theis,et al.  Towards a general independent subspace analysis , 2006, NIPS.

[32]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[33]  Wilkin Chau,et al.  The Talairach coordinate of a point in the MNI space: how to interpret it , 2005, NeuroImage.

[34]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[35]  Kevin Murphy,et al.  The impact of global signal regression on resting state correlations: Are anti-correlated networks introduced? , 2009, NeuroImage.

[36]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[37]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[38]  Robert Tibshirani,et al.  The out-of-bootstrap method for model averaging and selection , 1997 .

[39]  G. Rees,et al.  Predicting the orientation of invisible stimuli from activity in human primary visual cortex , 2005, Nature Neuroscience.

[40]  Motoaki Kawanabe,et al.  A resampling approach to estimate the stability of one-dimensional or multidimensional independent components , 2002, IEEE Transactions on Biomedical Engineering.

[41]  David E. Booth,et al.  Applied Multivariate Analysis , 2003, Technometrics.

[42]  A. Seth Causal connectivity of evolved neural networks during behavior. , 2005, Network.

[43]  Alexander Kraskov,et al.  Reliability of ICA Estimates with Mutual Information , 2004, ICA.

[44]  Eric Bauer,et al.  An Empirical Comparison of Voting Classification Algorithms: Bagging, Boosting, and Variants , 1999, Machine Learning.

[45]  Klaus Obermayer,et al.  Multi Dimensional ICA to Separate Correlated Sources , 2001, NIPS.

[46]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[47]  Allen W. Song,et al.  Differentiating Sensitivity of Post-Stimulus Undershoot under Diffusion Weighting: Implication of Vascular and Neuronal Hierarchy , 2008, PloS one.

[48]  J. Pekar,et al.  fMRI Activation in a Visual-Perception Task: Network of Areas Detected Using the General Linear Model and Independent Components Analysis , 2001, NeuroImage.

[49]  Karl J. Friston Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[50]  Vince D. Calhoun,et al.  ICA of functional MRI data: an overview. , 2003 .

[51]  R. Hari,et al.  Brain basis of human social interaction: from concepts to brain imaging. , 2009, Physiological reviews.

[52]  Andrzej Cichocki,et al.  Adaptive Blind Signal and Image Processing - Learning Algorithms and Applications , 2002 .

[53]  Vince D. Calhoun,et al.  A review of group ICA for fMRI data and ICA for joint inference of imaging, genetic, and ERP data , 2009, NeuroImage.

[54]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[55]  Andreas Bartels,et al.  Brain dynamics during natural viewing conditions—A new guide for mapping connectivity in vivo , 2005, NeuroImage.

[56]  Karl J. Friston,et al.  Analysis of fMRI Time-Series Revisited , 1995, NeuroImage.

[57]  S Makeig,et al.  Analysis of fMRI data by blind separation into independent spatial components , 1998, Human brain mapping.

[58]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[59]  Michael I. Jordan,et al.  FINDING CLUSTERS IN INDEPENDENT COMPONENT ANALYSIS , 2003 .

[60]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[61]  A. Dale,et al.  Selective averaging of rapidly presented individual trials using fMRI , 1997, Human brain mapping.

[62]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[63]  S. Rombouts,et al.  Consistent resting-state networks across healthy subjects , 2006, Proceedings of the National Academy of Sciences.

[64]  Karl J. Friston Functional integration and inference in the brain , 2002, Progress in Neurobiology.

[65]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[66]  J. Cardoso Blind Identification Of Independent Components With Higher-order Statistics , 1989, Workshop on Higher-Order Spectral Analysis.

[67]  Stefan Harmeling,et al.  ANALYSING ICA COMPONENTS BY INJECTING NOISE , 2003 .

[68]  B. Rosen,et al.  MRI measurement of the temporal evolution of relative CMRO2 during rat forepaw stimulation , 1999, Magnetic resonance in medicine.

[69]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[70]  Karl J. Friston,et al.  Dynamic causal modeling , 2010, Scholarpedia.

[71]  R. Buxton,et al.  A Model for the Coupling between Cerebral Blood Flow and Oxygen Metabolism during Neural Stimulation , 1997, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[72]  Douglas C. Noll,et al.  Accounting for nonlinear BOLD effects in fMRI: parameter estimates and a model for prediction in rapid event-related studies , 2005, NeuroImage.

[73]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[74]  T. Sejnowski,et al.  CONSISTENCY OF INFOMAX ICA DECOMPOSITION OF FUNCTIONAL BRAIN IMAGING DATA , 2003 .

[75]  M. D’Esposito,et al.  The Inferential Impact of Global Signal Covariates in Functional Neuroimaging Analyses , 1998, NeuroImage.

[76]  Herbert Lee,et al.  Bagging and the Bayesian Bootstrap , 2001, AISTATS.

[77]  Yul-Wan Sung,et al.  Functional magnetic resonance imaging , 2004, Scholarpedia.

[78]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[79]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[80]  Gene H. Golub,et al.  Matrix computations , 1983 .

[81]  Aapo Hyvärinen,et al.  Validating the independent components of neuroimaging time series via clustering and visualization , 2004, NeuroImage.

[82]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[83]  R Baumgartner,et al.  Resampling as a cluster validation technique in fMRI , 2000, Journal of magnetic resonance imaging : JMRI.

[84]  Raul Cano On The Bayesian Bootstrap , 1992 .

[85]  M. Fox,et al.  The global signal and observed anticorrelated resting state brain networks. , 2009, Journal of neurophysiology.

[86]  Arthur W Toga,et al.  The LONI Pipeline Processing Environment , 2003, NeuroImage.

[87]  J. Kettenring,et al.  Canonical Analysis of Several Sets of Variables , 2022 .

[88]  Diego Sona,et al.  Inferring Cognition from fMRI Brain Images , 2007, ICANN.

[89]  Aapo Hyvärinen,et al.  Emergence of Phase- and Shift-Invariant Features by Decomposition of Natural Images into Independent Feature Subspaces , 2000, Neural Computation.

[90]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[91]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[92]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[93]  Joachim M. Buhmann,et al.  Stability-Based Validation of Clustering Solutions , 2004, Neural Computation.

[94]  G. Edelman,et al.  A measure for brain complexity: relating functional segregation and integration in the nervous system. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[95]  H. Knutsson,et al.  Detection of neural activity in functional MRI using canonical correlation analysis , 2001, Magnetic resonance in medicine.

[96]  E. Oja,et al.  Performance Analysis of the FastICA Algorithm and Cramér – Rao Bounds for Linear Independent Component Analysis , 2010 .

[97]  Michael Breakspear,et al.  Spatiotemporal wavelet resampling for functional neuroimaging data , 2004, Human brain mapping.

[98]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[99]  Erkki Oja,et al.  The FastICA Algorithm Revisited: Convergence Analysis , 2006, IEEE Transactions on Neural Networks.

[100]  L. Nolan,et al.  Biological psychology , 2019, An Introduction to the Psychology of Humor.

[101]  N. Murata,et al.  AN APPROACH OF GROUPING DECOMPOSED COMPONENTS , 2003 .

[102]  Riitta Hari,et al.  Towards natural stimulation in fMRI—Issues of data analysis , 2007, NeuroImage.

[103]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[104]  Ricardo Vigário,et al.  Overlearning in Marginal Distribution-Based ICA: Analysis and Solutions , 2003, J. Mach. Learn. Res..

[105]  J. Pekar,et al.  Different activation dynamics in multiple neural systems during simulated driving , 2002, Human brain mapping.

[106]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[107]  Yuanqing Li,et al.  Analysis of Sparse Representation and Blind Source Separation , 2004, Neural Computation.

[108]  Jianbo Shi,et al.  A Random Walks View of Spectral Segmentation , 2001, AISTATS.

[109]  Andreas Ziehe,et al.  TDSEP { an e(cid:14)cient algorithm for blind separation using time structure , 1998 .

[110]  Karl J. Friston,et al.  Comparing dynamic causal models , 2004, NeuroImage.

[111]  João Ricardo Sato,et al.  Wavelet based time-varying vector autoregressive modelling , 2007, Comput. Stat. Data Anal..