Binocular Disparity Tuning and Visual–Vestibular Congruency of Multisensory Neurons in Macaque Parietal Cortex

Many neurons in the dorsal medial superior temporal (MSTd) and ventral intraparietal (VIP) areas of the macaque brain are multisensory, responding to both optic flow and vestibular cues to self-motion. The heading tuning of visual and vestibular responses can be either congruent or opposite, but only congruent cells have been implicated in cue integration for heading perception. Because of the geometric properties of motion parallax, however, both congruent and opposite cells could be involved in coding self-motion when observers fixate a world-fixed target during translation, if congruent cells prefer near disparities and opposite cells prefer far disparities. We characterized the binocular disparity selectivity and heading tuning of MSTd and VIP cells using random-dot stimuli. Most (70%) MSTd neurons were disparity selective with monotonic tuning, and there was no consistent relationship between depth preference and congruency of visual and vestibular heading tuning. One-third of disparity-selective MSTd cells reversed their depth preference for opposite directions of motion [direction-dependent disparity tuning (DDD)], but most of these cells were unisensory with no tuning for vestibular stimuli. Inconsistent with previous reports, the direction preferences of most DDD neurons do not reverse with disparity. By comparison to MSTd, VIP contains fewer disparity-selective neurons (41%) and very few DDD cells. On average, VIP neurons also preferred higher speeds and nearer disparities than MSTd cells. Our findings are inconsistent with the hypothesis that visual/vestibular congruency is linked to depth preference, and also suggest that DDD cells are not involved in multisensory integration for heading perception.

[1]  G. DeAngelis,et al.  A Logarithmic, Scale-Invariant Representation of Speed in Macaque Middle Temporal Area Accounts for Speed Discrimination Performance , 2005, The Journal of Neuroscience.

[2]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[3]  H. Komatsu,et al.  Disparity sensitivity of neurons in monkey extrastriate area MST , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  R. Wurtz,et al.  Response to motion in extrastriate area MSTl: disparity sensitivity. , 1999, Journal of neurophysiology.

[5]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[6]  K. Hoffmann,et al.  Linear Vestibular Self‐Motion Signals in Monkey Medial Superior Temporal Area , 1999, Annals of the New York Academy of Sciences.

[7]  C. Duffy MST neurons respond to optic flow and translational movement. , 1998, Journal of neurophysiology.

[8]  A. Churchland,et al.  Relationship between extraretinal component of firing rate and eye speed in area MST of macaque monkeys. , 2005, Journal of neurophysiology.

[9]  R. Hetherington The Perception of the Visual World , 1952 .

[10]  Gregory C DeAngelis,et al.  Macaque Middle Temporal Neurons Signal Depth in the Absence of Motion , 2003, The Journal of Neuroscience.

[11]  S. Yamane,et al.  Neural activity in cortical area MST of alert monkey during ocular following responses. , 1994, Journal of neurophysiology.

[12]  Dora E Angelaki,et al.  Visual and Nonvisual Contributions to Three-Dimensional Heading Selectivity in the Medial Superior Temporal Area , 2006, The Journal of Neuroscience.

[13]  D. Angelaki,et al.  Vestibular system: the many facets of a multimodal sense. , 2008, Annual review of neuroscience.

[14]  G. DeAngelis,et al.  Representation of Vestibular and Visual Cues to Self-Motion in Ventral Intraparietal Cortex , 2011, The Journal of Neuroscience.

[15]  D. Robinson,et al.  A METHOD OF MEASURING EYE MOVEMENT USING A SCLERAL SEARCH COIL IN A MAGNETIC FIELD. , 1963, IEEE transactions on bio-medical engineering.

[16]  C. Duffy,et al.  Heading representation in MST: sensory interactions and population encoding. , 2003, Journal of neurophysiology.

[17]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[18]  F. A. Miles,et al.  Single-unit activity in cortical area MST associated with disparity-vergence eye movements: evidence for population coding. , 2001, Journal of neurophysiology.

[19]  A. Takemura,et al.  The effect of disparity on the very earliest ocular following responses and the initial neuronal activity in monkey cortical area MST , 2000, Neuroscience Research.

[20]  Yong Gu,et al.  Decoding of MSTd Population Activity Accounts for Variations in the Precision of Heading Perception , 2010, Neuron.

[21]  M. Goldberg,et al.  Ventral intraparietal area of the macaque: anatomic location and visual response properties. , 1993, Journal of neurophysiology.

[22]  Xin Huang,et al.  Responses of neurons in the medial superior temporal visual area to apparent motion stimuli in macaque monkeys. , 2007, Journal of neurophysiology.

[23]  Frank Bremmer,et al.  Interaction of linear vestibular and visual stimulation in the macaque ventral intraparietal area (VIP) , 2002, The European journal of neuroscience.

[24]  François Klam,et al.  ã Federation of European Neuroscience Societies Visual±vestibular interactive responses in the macaque ventral intraparietal area (VIP) , 2022 .

[25]  G. DeAngelis,et al.  Multisensory Integration in Macaque Visual Cortex Depends on Cue Reliability , 2008, Neuron.

[26]  Gregory C DeAngelis,et al.  Effect of vertical disparities on depth representation in macaque monkeys: MT physiology and behavior. , 2008, Journal of neurophysiology.

[27]  Dora E Angelaki,et al.  Convergence of Vestibular and Visual Self-Motion Signals in an Area of the Posterior Sylvian Fissure , 2011, The Journal of Neuroscience.

[28]  G. DeAngelis,et al.  Multimodal Coding of Three-Dimensional Rotation and Translation in Area MSTd: Comparison of Visual and Vestibular Selectivity , 2007, The Journal of Neuroscience.

[29]  Gregory C. DeAngelis,et al.  A neural representation of depth from motion parallax in macaque visual cortex , 2008, Nature.

[30]  R. Wurtz,et al.  The role of disparity-sensitive cortical neurons in signalling the direction of self-motion , 1990, Nature.

[31]  R. Wurtz,et al.  Medial Superior Temporal Area Neurons Respond to Speed Patterns in Optic Flow , 1997, The Journal of Neuroscience.

[32]  G. DeAngelis,et al.  Neural correlates of multisensory cue integration in macaque MSTd , 2008, Nature Neuroscience.

[33]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[34]  G. DeAngelis,et al.  Coding of Stereoscopic Depth Information in Visual Areas V3 and V3A , 2011, The Journal of Neuroscience.

[35]  Mark Nawrot,et al.  MT Neurons Combine Visual Motion with a Smooth Eye Movement Signal to Code Depth-Sign from Motion Parallax , 2009, Neuron.