Influences of High-Level Features, Gaze, and Scene Transitions on the Reliability of BOLD Responses to Natural Movie Stimuli

Complex, sustained, dynamic, and naturalistic visual stimulation can evoke distributed brain activities that are highly reproducible within and across individuals. However, the precise origins of such reproducible responses remain incompletely understood. Here, we employed concurrent functional magnetic resonance imaging (fMRI) and eye tracking to investigate the experimental and behavioral factors that influence fMRI activity and its intra- and inter-subject reproducibility during repeated movie stimuli. We found that widely distributed and highly reproducible fMRI responses were attributed primarily to the high-level natural content in the movie. In the absence of such natural content, low-level visual features alone in a spatiotemporally scrambled control stimulus evoked significantly reduced degree and extent of reproducible responses, which were mostly confined to the primary visual cortex (V1). We also found that the varying gaze behavior affected the cortical response at the peripheral part of V1 and in the oculomotor network, with minor effects on the response reproducibility over the extrastriate visual areas. Lastly, scene transitions in the movie stimulus due to film editing partly caused the reproducible fMRI responses at widespread cortical areas, especially along the ventral visual pathway. Therefore, the naturalistic nature of a movie stimulus is necessary for driving highly reliable visual activations. In a movie-stimulation paradigm, scene transitions and individuals’ gaze behavior should be taken as potential confounding factors in order to properly interpret cortical activity that supports natural vision.

[1]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[2]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[3]  Yvonne Herz Extrageniculostriate Mechanisms Underlying Visually Guided Orientation Behavior , 2016 .

[4]  R. Guillery,et al.  On the actions that one nerve cell can have on another: distinguishing "drivers" from "modulators". , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[5]  N. Kanwisher,et al.  Visual attention: Insights from brain imaging , 2000, Nature Reviews Neuroscience.

[6]  T. Hendler,et al.  A hierarchical axis of object processing stages in the human visual cortex. , 2001, Cerebral cortex.

[7]  D. Heeger,et al.  Slow Cortical Dynamics and the Accumulation of Information over Long Timescales , 2012, Neuron.

[8]  F Mechler,et al.  Robust Temporal Coding of Contrast by V1 Neurons for Transient But Not for Steady-State Stimuli , 1998, The Journal of Neuroscience.

[9]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[10]  Eliana M. Klier,et al.  The superior colliculus encodes gaze commands in retinal coordinates , 2001, Nature Neuroscience.

[11]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[12]  Jianhua Lu,et al.  A simple and efficient search algorithm for block-matching motion estimation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[14]  Timothy O. Laumann,et al.  Informatics and Data Mining Tools and Strategies for the Human Connectome Project , 2011, Front. Neuroinform..

[15]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[16]  Jeffrey M. Zacks,et al.  Human brain activity time-locked to perceptual event boundaries , 2001, Nature Neuroscience.

[17]  Frances S. Chance,et al.  Drivers and modulators from push-pull and balanced synaptic input. , 2005, Progress in brain research.

[18]  Arthur Gretton,et al.  Low-Frequency Local Field Potentials and Spikes in Primary Visual Cortex Convey Independent Visual Information , 2008, The Journal of Neuroscience.

[19]  R. Hainer,et al.  American Association for the Advancement of Science , 1879, Nature.

[20]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[21]  Jack L. Gallant,et al.  A Continuous Semantic Space Describes the Representation of Thousands of Object and Action Categories across the Human Brain , 2012, Neuron.

[22]  T. Paus,et al.  Cortical regions involved in eye movements, shifts of attention, and gaze perception , 2005, Human brain mapping.

[23]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[24]  Iiro P. Jääskeläinen,et al.  Combined MEG and EEG show reliable patterns of electromagnetic brain activity during natural viewing , 2015, NeuroImage.

[25]  C. Pierrot-Deseilligny,et al.  Decisional role of the dorsolateral prefrontal cortex in ocular motor behaviour. , 2003, Brain : a journal of neurology.

[26]  Riitta Hari,et al.  Intersubject consistency of cortical MEG signals during movie viewing , 2014, NeuroImage.

[27]  D. Heeger,et al.  Neurocinematics: The Neuroscience of Film , 2008 .

[28]  D. Heeger,et al.  A Hierarchy of Temporal Receptive Windows in Human Cortex , 2008, The Journal of Neuroscience.

[29]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[30]  Rafael Malach,et al.  Selectivity of audiovisual ECoG responses revealed under naturalistic stimuli in the human cortex. , 2013, Journal of neurophysiology.

[31]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[32]  S. Zeki,et al.  Functional brain mapping during free viewing of natural scenes , 2004, Human brain mapping.

[33]  Jussi Tohka,et al.  A versatile software package for inter-subject correlation based analyses of fMRI , 2014, Front. Neuroinform..

[34]  D. Heeger,et al.  Reliability of cortical activity during natural stimulation , 2010, Trends in Cognitive Sciences.

[35]  P. Cavanagh,et al.  Retinotopy and color sensitivity in human visual cortical area V8 , 1998, Nature Neuroscience.

[36]  David A. Leopold,et al.  Functional MRI mapping of dynamic visual features during natural viewing in the macaque , 2015, NeuroImage.

[37]  M. Sams,et al.  Inter-Subject Synchronization of Prefrontal Cortex Hemodynamic Activity During Natural Viewing , 2008, The open neuroimaging journal.

[38]  R. Malach,et al.  Intersubject Synchronization of Cortical Activity During Natural Vision , 2004, Science.

[39]  D. Hubel,et al.  Receptive fields and functional architecture of monkey striate cortex , 1968, The Journal of physiology.