Integration of visual and non-visual self-motion cues during voluntary head movements in the human brain

&NA; Our phenomenological experience of the stable world is maintained by continuous integration of visual self‐motion with extra‐retinal signals. However, due to conventional constraints of fMRI acquisition in humans, neural responses to visuo‐vestibular integration have only been studied using artificial stimuli, in the absence of voluntary head‐motion. We here circumvented these limitations and let participants to move their heads during scanning. The slow dynamics of the BOLD signal allowed us to acquire neural signal related to head motion after the observer's head was stabilized by inflatable aircushions. Visual stimuli were presented on head‐fixed display goggles and updated in real time as a function of head‐motion that was tracked using an external camera. Two conditions simulated forward translation of the participant. During physical head rotation, the congruent condition simulated a stable world, whereas the incongruent condition added arbitrary lateral motion. Importantly, both conditions were precisely matched in visual properties and head‐rotation. By comparing congruent with incongruent conditions we found evidence consistent with the multi‐modal integration of visual cues with head motion into a coherent “stable world” percept in the parietal operculum and in an anterior part of parieto‐insular cortex (aPIC). In the visual motion network, human regions MST, a dorsal part of VIP, the cingulate sulcus visual area (CSv) and a region in precuneus (Pc) showed differential responses to the same contrast. The results demonstrate for the first time neural multimodal interactions between precisely matched congruent versus incongruent visual and non‐visual cues during physical head‐movement in the human brain. The methodological approach opens the path to a new class of fMRI studies with unprecedented temporal and spatial control over visuo‐vestibular stimulation. HighlightsFirst fMRI study integrating voluntary head motion with visual selfmotion.BOLD dynamics allowed to acquire neural responses to head motion after offset.Evidence for multi‐modal integration in insular and visual motion regions.Allows future fMRI with high spatio‐temporal control over vestibular stimulation.

[1]  D. Sharp,et al.  Functional neuroimaging of visuo-vestibular interaction , 2016, Brain Structure and Function.

[2]  R W Cox,et al.  Event‐related fMRI of tasks involving brief motion , 1999, Human brain mapping.

[3]  N. Logothetis,et al.  Integration of Touch and Sound in Auditory Cortex , 2005, Neuron.

[4]  Mark W. Greenlee,et al.  Cross-Modal Attention Effects in the Vestibular Cortex during Attentive Tracking of Moving Objects , 2016, The Journal of Neuroscience.

[5]  T. Stanford,et al.  Challenges in quantifying multisensory integration: alternative criteria, models, and inverse effectiveness , 2009, Experimental Brain Research.

[6]  T. Brandt,et al.  Sensory system interactions during simultaneous vestibular and visual stimulation in PET , 2002, Human brain mapping.

[7]  Guy A. Orban,et al.  Similarities and differences in motion processing between the human and macaque brain: evidence from fMRI , 2003, Neuropsychologia.

[8]  Ruey-Song Huang,et al.  Neural Substrates Underlying the Passive Observation and Active Control of Translational Egomotion , 2015, The Journal of Neuroscience.

[9]  Ravi S. Menon,et al.  Distinguishing subregions of the human MT+ complex using visual fields and pursuit eye movements. , 2001, Journal of neurophysiology.

[10]  Richard S. Frackowiak,et al.  Neural Correlates of Visual-Motion Perception as Object- or Self-motion , 2002, NeuroImage.

[11]  T. Brandt,et al.  Multisensory cortical signal increases and decreases during vestibular galvanic stimulation (fMRI). , 2001, Journal of neurophysiology.

[12]  Steven C. R. Williams,et al.  A comprehensive testing protocol for MRI neuroanatomical segmentation techniques: Evaluation of a novel lateral ventricle segmentation method , 2011, NeuroImage.

[13]  T. Brandt,et al.  Reciprocal inhibitory visual-vestibular interaction. Visual motion stimulation deactivates the parieto-insular vestibular cortex. , 1998, Brain : a journal of neurology.

[14]  T. Brandt,et al.  Functional brain imaging of peripheral and central vestibular disorders. , 2008, Brain : a journal of neurology.

[15]  Tao Zhang,et al.  Parietal Area VIP Causally Influences Heading Perception during Pursuit Eye Movements , 2011, The Journal of Neuroscience.

[16]  Michael F Land,et al.  Do we have an internal model of the outside world? , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  R. Campbell,et al.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex , 2000, Current Biology.

[18]  Christian Büchel,et al.  Spatial updating: how the brain keeps track of changing object locations during observer motion , 2008, Nature Neuroscience.

[19]  Andreas Bartels,et al.  Human Areas V3A and V6 Compensate for Self-Induced Planar Visual Motion , 2012, Neuron.

[20]  G. Orban,et al.  Motion-responsive regions of the human brain , 1999, Experimental Brain Research.

[21]  O J Grüsser,et al.  Localization and responses of neurones in the parieto‐insular vestibular cortex of awake monkeys (Macaca fascicularis). , 1990, The Journal of physiology.

[22]  D. Heeger,et al.  Retinotopy and Functional Subdivision of Human Areas MT and MST , 2002, The Journal of Neuroscience.

[23]  Sebastian M. Frank,et al.  Vestibular and visual responses in human posterior insular cortex. , 2014, Journal of neurophysiology.

[24]  Nikos K Logothetis,et al.  Interpreting the BOLD signal. , 2004, Annual review of physiology.

[25]  Yoshiharu Sakata,et al.  The Vestibular Cortex , 2002 .

[26]  Dora E Angelaki,et al.  Macaque Parieto-Insular Vestibular Cortex: Responses to Self-Motion and Optic Flow , 2010, Journal of Neuroscience.

[27]  D. Burr,et al.  A cortical area that responds specifically to optic flow, revealed by fMRI , 2000, Nature Neuroscience.

[28]  Rüdiger Wenzel,et al.  Human Vestibular Cortex as Identified with Caloric Stimulation in Functional Magnetic Resonance Imaging , 2002, NeuroImage.

[29]  Laurent Petit,et al.  Neural basis of visually guided head movements studied with fMRI. , 2003, Journal of neurophysiology.

[30]  N. Logothetis What we can do and what we cannot do with fMRI , 2008, Nature.

[31]  Andrew T. Smith,et al.  Neural Mechanisms for Discounting Head-Roll-Induced Retinal Motion , 2015, The Journal of Neuroscience.

[32]  T. Brandt,et al.  The Vestibular Cortex: Its Locations, Functions, and Disorders , 1999, Annals of the New York Academy of Sciences.

[33]  Andrew T. Smith,et al.  The Representation of Egomotion in the Human Brain , 2008, Current Biology.

[34]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[35]  M. Whitton,et al.  Effect of latency on presence in stressful virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[36]  A. Bartels,et al.  Parietal Cortex Codes for Egocentric Space beyond the Field of View , 2012, Current Biology.

[37]  Velia Cardin,et al.  Sensitivity of human visual and vestibular cortical regions to egomotion-compatible visual stimulation. , 2010, Cerebral cortex.

[38]  Jennifer L. Campos,et al.  Contributions of visual and proprioceptive information to travelled distance estimation during changing sensory congruencies , 2014, Experimental Brain Research.

[39]  K. Amunts,et al.  The human parietal operculum. II. Stereotaxic maps and correlation with functional imaging results. , 2006, Cerebral cortex.

[40]  M. Wiesmann,et al.  Cerebral functional magnetic resonance imaging of vestibular, auditory, and nociceptive areas during galvanic stimulation , 1998, Annals of neurology.

[41]  Jennifer L. Campos,et al.  Bayesian integration of visual and vestibular signals for heading. , 2009, Journal of vision.

[42]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[43]  Sebastian M. Frank,et al.  Visual-vestibular processing in the human Sylvian fissure. , 2016, Journal of neurophysiology.

[44]  D. Angelaki,et al.  Vestibular system: the many facets of a multimodal sense. , 2008, Annual review of neuroscience.

[45]  Timothy O. Laumann,et al.  Methods to detect, characterize, and remove motion artifact in resting state fMRI , 2014, NeuroImage.

[46]  G. DeAngelis,et al.  Representation of Vestibular and Visual Cues to Self-Motion in Ventral Intraparietal Cortex , 2011, The Journal of Neuroscience.

[47]  Andreas Bartels,et al.  Visual Motion Responses in the Posterior Cingulate Sulcus: A Comparison to V5/MT and MST , 2011, Cerebral cortex.

[48]  K. Zilles,et al.  Polymodal Motion Processing in Posterior Parietal and Premotor Cortex A Human fMRI Study Strongly Implies Equivalencies between Humans and Monkeys , 2001, Neuron.

[49]  G. DeAngelis,et al.  Multimodal Coding of Three-Dimensional Rotation and Translation in Area MSTd: Comparison of Visual and Vestibular Selectivity , 2007, The Journal of Neuroscience.

[50]  Simon B. Eickhoff,et al.  Meta-analytical definition and functional connectivity of the human vestibular cortex , 2012, NeuroImage.

[51]  K. Thilo,et al.  Vestibular inputs to human motion-sensitive visual cortex. , 2012, Cerebral cortex.

[52]  Peter Thier,et al.  False perception of motion in a patient who cannot compensate for eye movements , 1997, Nature.

[53]  Dora E Angelaki,et al.  Functional Specializations of the Ventral Intraparietal Area for Multisensory Heading Discrimination , 2013, The Journal of Neuroscience.