Inferring consistent functional interaction patterns from natural stimulus FMRI data

There has been increasing interest in how the human brain responds to natural stimulus such as video watching in the neuroimaging field. Along this direction, this paper presents our effort in inferring consistent and reproducible functional interaction patterns under natural stimulus of video watching among known functional brain regions identified by task-based fMRI. Then, we applied and compared four statistical approaches, including Bayesian network modeling with searching algorithms: greedy equivalence search (GES), Peter and Clark (PC) analysis, independent multiple greedy equivalence search (IMaGES), and the commonly used Granger causality analysis (GCA), to infer consistent and reproducible functional interaction patterns among these brain regions. It is interesting that a number of reliable and consistent functional interaction patterns were identified by the GES, PC and IMaGES algorithms in different participating subjects when they watched multiple video shots of the same semantic category. These interaction patterns are meaningful given current neuroscience knowledge and are reasonably reproducible across different brains and video shots. In particular, these consistent functional interaction patterns are supported by structural connections derived from diffusion tensor imaging (DTI) data, suggesting the structural underpinnings of consistent functional interactions. Our work demonstrates that specific consistent patterns of functional interactions among relevant brain regions might reflect the brain's fundamental mechanisms of online processing and comprehension of video messages.

[1]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[2]  Linda G. Shapiro,et al.  Computer and Robot Vision , 1991 .

[3]  Andreas Bartels,et al.  Brain dynamics during natural viewing conditions—A new guide for mapping connectivity in vivo , 2005, NeuroImage.

[4]  Degang Zhang,et al.  Optimization of functional brain ROIs via maximization of consistency of structural connectivity profiles , 2011, ISBI.

[5]  Russell A. Poldrack,et al.  Six problems for causal inference from fMRI , 2010, NeuroImage.

[6]  C. Glymour The Mind's Arrows: Bayes Nets and Graphical Causal Models in Psychology , 2000 .

[7]  C. J. Honeya,et al.  Predicting human resting-state functional connectivity from structural connectivity , 2009 .

[8]  R. Goebel,et al.  Visual target modulation of functional connectivity networks revealed by self‐organizing group ICA , 2008, Human brain mapping.

[9]  Xian-Sheng Hua,et al.  Bridging low-level features and high-level semantics via fMRI brain imaging for video classification , 2010, ACM Multimedia.

[10]  Karl J. Friston Modalities, Modes, and Models in Functional Neuroimaging , 2009, Science.

[11]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[12]  Clark Glymour,et al.  Multi-subject search correctly identifies causal connections and most causal directions in the DCM models of the Smith et al. simulation study , 2011, NeuroImage.

[13]  Andrew D. Engell,et al.  Distributed representations of dynamic facial expressions in the superior temporal sulcus. , 2010, Journal of vision.

[14]  P. Spirtes,et al.  Causation, Prediction, and Search, 2nd Edition , 2001 .

[15]  Fei-Fei Li,et al.  Exploring Functional Connectivities of the Human Brain using Multivariate Information Analysis , 2009, NIPS.

[16]  Sheng He,et al.  Larger stimuli are judged to last longer. , 2007, Journal of vision.

[17]  Karl J. Friston,et al.  Dynamic causal modelling , 2003, NeuroImage.

[18]  C. Meek,et al.  Graphical models: selecting causal and statistical models , 1997 .

[19]  Mark W. Woolrich,et al.  Bayesian analysis of neuroimaging data in FSL , 2009, NeuroImage.

[20]  Z. Jane Wang,et al.  Controlling the False Discovery Rate of the Association/Causality Structure Learned with the PC Algorithm , 2009, J. Mach. Learn. Res..

[21]  Nao Ninomiya,et al.  The 10th anniversary of journal of visualization , 2007, J. Vis..

[22]  Mark W. Woolrich,et al.  Network modelling methods for FMRI , 2011, NeuroImage.

[23]  Ingo Brigandt Review: The Mind's Arrows: Bayes Nets and Graphical Causal Models in Psychology by Clark Glymour , 2003 .

[24]  Kaiming Li,et al.  Fiber-Centered Granger Causality Analysis , 2011, MICCAI.

[25]  Yadin Dudai,et al.  Enslaving Central Executives: Toward a Brain Theory of Cinema , 2008 .

[26]  Jinglei Lv,et al.  Activated Fibers: Fiber-Centered Activation Detection in Task-Based FMRI , 2011, IPMI.

[27]  James L. McClelland,et al.  Connectionist Models , 2010 .

[28]  Katsumi Aoki,et al.  Recent development of flow visualization , 2004, J. Vis..

[29]  Richard E. Neapolitan,et al.  Learning Bayesian networks , 2007, KDD '07.

[30]  Timothy Edward John Behrens,et al.  Characterization and propagation of uncertainty in diffusion‐weighted MR imaging , 2003, Magnetic resonance in medicine.

[31]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[32]  Anil K. Seth,et al.  A MATLAB toolbox for Granger causal connectivity analysis , 2010, Journal of Neuroscience Methods.

[33]  Rainer Goebel,et al.  Mapping directed influence over the brain using Granger causality and fMRI , 2005, NeuroImage.

[34]  Thomas Hofmann,et al.  Learning Structural Equation Models for fMRI , 2007 .

[35]  Dirk B. Walther,et al.  Natural Scene Categories Revealed in Distributed Patterns of Activity in the Human Brain , 2009, The Journal of Neuroscience.

[36]  M. Fox,et al.  Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging , 2007, Nature Reviews Neuroscience.

[37]  P. Sajda,et al.  Cortically coupled computer vision for rapid image search , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[38]  Jessica A. Turner,et al.  Neuroinformatics Original Research Article , 2022 .

[39]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[40]  J. Gallant,et al.  Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies , 2011, Current Biology.

[41]  Guillén Fernández,et al.  Language Mapping in Less Than 15 Minutes: Real-Time Functional MRI during Routine Clinical Investigation , 2001, NeuroImage.

[42]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[43]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[44]  C. Granger Investigating causal relations by econometric models and cross-spectral methods , 1969 .

[45]  Klaas E. Stephan,et al.  The anatomical basis of functional localization in the cortex , 2002, Nature Reviews Neuroscience.

[46]  Karl J. Friston,et al.  Dynamic causal modeling , 2010, Scholarpedia.

[47]  Xian-Sheng Hua,et al.  Bridging the Semantic Gap via Functional Brain Imaging , 2012, IEEE Transactions on Multimedia.

[48]  Shih-Fu Chang,et al.  Brain state decoding for rapid image retrieval , 2009, ACM Multimedia.

[49]  P. Spirtes,et al.  Causation, prediction, and search , 1993 .

[50]  Degang Zhang,et al.  Complex span tasks and hippocampal recruitment during working memory , 2011, NeuroImage.

[51]  Damien A. Fair,et al.  Defining functional areas in individual human brains using resting functional connectivity MRI , 2008, NeuroImage.

[52]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[53]  C. Granger Investigating Causal Relations by Econometric Models and Cross-Spectral Methods , 1969 .

[54]  Degang Zhang,et al.  Individualized ROI Optimization via Maximization of Group-wise Consistency of Structural and Functional Profiles , 2010, NIPS.

[55]  P. Spirtes,et al.  An Algorithm for Fast Recovery of Sparse Causal Graphs , 1991 .

[56]  Rafael Malach,et al.  Extrinsic and intrinsic systems in the posterior cortex of the human brain revealed during natural sensory stimulation. , 2007, Cerebral cortex.

[57]  Karl J. Friston,et al.  A unified statistical approach for determining significant signals in images of cerebral activation , 1996, Human brain mapping.

[58]  S. Kastner,et al.  Complex organization of human primary motor cortex: a high-resolution fMRI study. , 2008, Journal of neurophysiology.

[59]  M. P. van den Heuvel,et al.  Normalized Cut Group Clustering of Resting-State fMRI Data , 2008, PloS one.

[60]  Jun Fang,et al.  Retrieving video shots in semantic brain imaging space using manifold-ranking , 2011, 2011 18th IEEE International Conference on Image Processing.