A studyforrest extension, simultaneous fMRI and eye gaze recordings during prolonged natural stimulation

Here we present an update of the studyforrest (http://studyforrest.org) dataset that complements the previously released functional magnetic resonance imaging (fMRI) data for natural language processing with a new two-hour 3 Tesla fMRI acquisition while 15 of the original participants were shown an audio-visual version of the stimulus motion picture. We demonstrate with two validation analyses that these new data support modeling specific properties of the complex natural stimulus, as well as a substantial within-subject BOLD response congruency in brain areas related to the processing of auditory inputs, speech, and narrative when compared to the existing fMRI data for audio-only stimulation. In addition, we provide participants' eye gaze location as recorded simultaneously with fMRI, and an additional sample of 15 control participants whose eye gaze trajectories for the entire movie were recorded in a lab setting—to enable studies on attentional processes and comparative investigations on the potential impact of the stimulation setting on these processes.

[1]  K. R. Ridderinkhof,et al.  Neurocognitive mechanisms of cognitive control: The role of prefrontal cortex in action selection, response inhibition, performance monitoring, and reward-based learning , 2004, Brain and Cognition.

[2]  Po-Hsuan Chen,et al.  A Reduced-Dimension fMRI Shared Response Model , 2015, NIPS.

[3]  Patrik Vuilleumier,et al.  Cognitive and affective theory of mind share the same local patterns of activity in posterior temporal but not medial prefrontal cortex. , 2014, Social cognitive and affective neuroscience.

[4]  Andreas Bartels,et al.  Face processing regions are sensitive to distinct aspects of temporal sequence in facial dynamics , 2014, NeuroImage.

[5]  F. Hesse,et al.  Relative effectiveness and validity of mood induction procedures : a meta-analysis , 1996 .

[6]  J. Haxby,et al.  The representation of self and person knowledge in the medial prefrontal cortex. , 2012, Wiley interdisciplinary reviews. Cognitive science.

[7]  Forrest Gump.  Portrayed emotions in the movie " , 2017 .

[8]  Russell A. Poldrack,et al.  Large-scale automated synthesis of human functional neuroimaging data , 2011, Nature Methods.

[9]  Michael Hanke,et al.  A studyforrest extension, retinotopic mapping and localization of higher visual areas , 2016, Scientific Data.

[10]  C. Frith,et al.  Meeting of minds: the medial frontal cortex and social cognition , 2006, Nature Reviews Neuroscience.

[11]  C Tempelmann,et al.  Electrodynamic headphones and woofers for application in magnetic resonance imaging scanners. , 1998, Medical physics.

[12]  Mario Beauregard,et al.  Film Excerpts Shown to Specifically Elicit Various Affects Lead to Overlapping Activation Foci in a Large Set of Symmetrical Brain Regions in Males , 2011, PloS one.

[13]  R. Lane,et al.  Neuroanatomical correlates of happiness, sadness, and disgust. , 1997, The American journal of psychiatry.

[14]  Michael Hanke,et al.  Portrayed emotions in the movie "Forrest Gump" , 2015, F1000Research.

[15]  Stephen M. Smith,et al.  Temporal Autocorrelation in Univariate Linear Modeling of FMRI Data , 2001, NeuroImage.

[16]  M. Ullsperger,et al.  Neurophysiology of performance monitoring and adaptive behavior. , 2014, Physiological reviews.

[17]  Nobuyuki Hiruma,et al.  Decoding Humor Experiences from Brain Activity of People Viewing Comedy Movies , 2013, PloS one.

[18]  André Brechmann,et al.  Auditory intensity processing: Effect of MRI background noise , 2016, Hearing Research.

[19]  Christopher J. Honey,et al.  Future trends in Neuroimaging: Neural processes as expressed within real-life contexts , 2012, NeuroImage.

[20]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[21]  Talma Hendler,et al.  Portraying emotions at their unfolding: A multilayered approach for probing dynamics of neural networks , 2012, NeuroImage.

[22]  Michael A. Casey,et al.  High-resolution 7-Tesla fMRI data on the perception of musical , 2016 .

[23]  Mikko Sams,et al.  Naturalistic fMRI Mapping Reveals Superior Temporal Sulcus as the Hub for the Distributed Brain Network for Social Perception , 2012, Front. Hum. Neurosci..

[24]  Satrajit S. Ghosh,et al.  The brain imaging data structure, a format for organizing and describing outputs of neuroimaging experiments , 2016, Scientific Data.

[25]  M. Posner,et al.  Cognitive and emotional influences in anterior cingulate cortex , 2000, Trends in Cognitive Sciences.

[26]  Yaroslav O. Halchenko,et al.  Open is Not Enough. Let's Take the Next Step: An Integrated, Community-Driven Computing Platform for Neuroscience , 2012, Front. Neuroinform..

[27]  Marc Sollberger,et al.  Tracking emotional valence: The role of the orbitofrontal cortex , 2012, Human brain mapping.

[28]  Nathan Intrator,et al.  Functional Cliques in the Amygdala and Related Brain Networks Driven by Fear Assessment Acquired During Movie Viewing , 2011, Brain Connect..

[29]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[30]  J. Perner,et al.  Neuroscience and Biobehavioral Reviews Fractionating Theory of Mind: a Meta-analysis of Functional Brain Imaging Studies , 2022 .

[31]  Oliver Speck,et al.  A high-resolution 7-Tesla fMRI dataset from complex natural stimulation with an audio movie , 2014, Scientific Data.

[32]  J. Gross,et al.  Emotion elicitation using films , 1995 .

[33]  E. Macaluso,et al.  Stimulus-Driven Orienting of Visuo-Spatial Attention in Complex Dynamic Environments , 2011, Neuron.

[34]  Kevin N. Ochsner,et al.  Attention and emotion: Does rating emotion alter neural responses to amusing and sad films? , 2005, NeuroImage.