Area MT Encodes Three-Dimensional Motion

We use visual information to determine our dynamic relationship with other objects in a three-dimensional (3D) world. Despite decades of work on visual motion processing, it remains unclear how 3D directions—trajectories that include motion toward or away from the observer—are represented and processed in visual cortex. Area MT is heavily implicated in processing visual motion and depth, yet previous work has found little evidence for 3D direction sensitivity per se. Here we use a rich ensemble of binocular motion stimuli to reveal that most neurons in area MT of the anesthetized macaque encode 3D motion information. This tuning for 3D motion arises from multiple mechanisms, including different motion preferences in the two eyes and a nonlinear interaction of these signals when both eyes are stimulated. Using a novel method for functional binocular alignment, we were able to rule out contributions of static disparity tuning to the 3D motion tuning we observed. We propose that a primary function of MT is to encode 3D motion, critical for judging the movement of objects in dynamic real-world environments.

[1]  Dario L Ringach,et al.  Precise alignment of micromachined electrode arrays with V1 functional maps. , 2007, Journal of neurophysiology.

[2]  I. Ohzawa,et al.  Contrast Gain Control in the Visual Cortex: Monocular Versus Binocular Mechanisms , 2000, The Journal of Neuroscience.

[3]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[4]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[5]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[6]  B. G. Cumming,et al.  Binocular mechanisms for detecting motion-in-depth , 1994, Vision Research.

[7]  G. DeAngelis,et al.  Cortical area MT and the perception of stereoscopic depth , 1998, Nature.

[8]  Gregory C. DeAngelis,et al.  Depth is encoded in the visual cortex by a specialized receptive field structure , 1991, Nature.

[9]  R. Wurtz,et al.  Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. , 1991, Journal of neurophysiology.

[10]  A. Parker,et al.  Neurons in Dorsal Visual Area V5/MT Signal Relative Disparity , 2011, The Journal of Neuroscience.

[11]  A. Leventhal,et al.  Concomitant sensitivity to orientation, direction, and color of cells in layers 2, 3, and 4 of monkey striate cortex , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[12]  S. Zeki Cells responding to changing image size and disparity in the cortex of the rhesus monkey , 1974, The Journal of physiology.

[13]  M. Cynader,et al.  Neurones in cat parastriate cortex sensitive to the direction of motion in three‐dimensional space , 1978, The Journal of physiology.

[14]  Leland S Stone,et al.  Stereomotion speed perception: contributions from both changing disparity and interocular velocity difference over a range of relative disparities. , 2004, Journal of vision.

[15]  Bart Farell,et al.  Seeing motion in depth using inter-ocular velocity differences , 2005, Vision Research.

[16]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[17]  A. Parker,et al.  Quantitative analysis of the responses of V1 neurons to horizontal disparity in dynamic random-dot stereograms. , 2002, Journal of neurophysiology.

[18]  S. Morad,et al.  Ceramide-orchestrated signalling in cancer cells , 2012, Nature Reviews Cancer.

[19]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[20]  L. Cormack,et al.  Disparity- and velocity-based signals for three-dimensional motion perception in human MT+ , 2009, Nature Neuroscience.

[21]  J. Anthony Movshon,et al.  Comparison of Recordings from Microelectrode Arrays and Single Electrodes in the Visual Cortex , 2007, The Journal of Neuroscience.

[22]  Yukio Komatsu,et al.  Responsiveness of Clare-Bishop neurons to visual cues associated with motion of a visual stimulus in three-dimensional space , 1985, Vision Research.

[23]  Velia Cardin,et al.  Sensitivity of human visual cortical area V6 to stereoscopic depth gradients associated with self-motion , 2011, Journal of neurophysiology.

[24]  G. Orban,et al.  Spatial heterogeneity of inhibitory surrounds in the middle temporal visual area. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[25]  D. Regan,et al.  Binocular correlates of the direction of motion in depth , 1993, Vision Research.

[26]  Hirohisa Yaguchi,et al.  Integration of monocular motion signals and the analysis of interocular velocity differences for the perception of motion-in-depth. , 2009, Journal of vision.

[27]  L. P. O'Keefe,et al.  Processing of first- and second-order motion signals by neurons in area MT of the macaque monkey , 1998, Visual Neuroscience.

[28]  Doris Y. Tsao,et al.  A Cortical Region Consisting Entirely of Face-Selective Cells , 2006, Science.

[29]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[30]  Gregory C DeAngelis,et al.  Neural Representation of Motion-In-Depth in Area MT , 2014, The Journal of Neuroscience.

[31]  Lora T. Likova,et al.  Stereomotion processing in the human occipital cortex , 2007, NeuroImage.

[32]  B. R. Moore,et al.  A modification of the Rayleigh test for vector data , 1980 .

[33]  Yuichi Sakano,et al.  Motion aftereffect in depth based on binocular information. , 2012, Journal of vision.

[34]  G. Orban,et al.  Processing of kinetically defined boundaries in the cortical motion area MT of the macaque monkey. , 1995, Journal of neurophysiology.

[35]  Richard T Born,et al.  Joint tuning for direction of motion and binocular disparity in macaque MT is largely separable. , 2013, Journal of neurophysiology.

[36]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[37]  Eli Peli Vision multiplexing in the design of low vision devices , 2004 .

[38]  R A Andersen,et al.  The response of area MT and V1 neurons to transparent motion , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  K. H. Britten,et al.  Contrast dependence of response normalization in area MT of the rhesus macaque. , 2002, Journal of neurophysiology.

[40]  G A Orban,et al.  Selectivity of cat area 18 neurons for direction and speed in depth. , 1990, Journal of neurophysiology.

[41]  G. Orban,et al.  Selectivity of Macaque MT/V5 Neurons for Surface Orientation in Depth Specified by Motion , 1997, The European journal of neuroscience.

[42]  I. Ohzawa,et al.  Encoding of binocular disparity by complex cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[43]  G. Poggio,et al.  Mechanisms of static and dynamic stereopsis in foveal cortex of the rhesus monkey , 1981, The Journal of physiology.

[44]  G C DeAngelis,et al.  The physiology of stereopsis. , 2001, Annual review of neuroscience.

[45]  D. Regan,et al.  Cyclopean motion perception produced by Oscillations of size, disparity and location , 1996, Vision Research.

[46]  Gregory C DeAngelis,et al.  Coding of horizontal disparity and velocity by MT neurons in the alert macaque. , 2003, Journal of neurophysiology.

[47]  Melchi M. Michel,et al.  Intrinsic position uncertainty explains detection and localization performance in peripheral vision. , 2011, Journal of vision.

[48]  Thaddeus B. Czuba,et al.  Speed and eccentricity tuning reveal a central role for the velocity-based cue to 3D visual motion. , 2010, Journal of neurophysiology.

[49]  A. Parker,et al.  Sense and the single neuron: probing the physiology of perception. , 1998, Annual review of neuroscience.

[50]  D. Regan,et al.  Neurons in cat visual cortex tuned to the direction of motion in depth: Effect of positional disparity , 1982, Vision Research.

[51]  M. A. Smith,et al.  Spatial and Temporal Scales of Neuronal Correlation in Primary Visual Cortex , 2008, The Journal of Neuroscience.

[52]  William T. Newsome,et al.  Cortical microstimulation influences perceptual judgements of motion direction , 1990, Nature.

[53]  I. Ohzawa,et al.  Encoding of binocular disparity by simple cells in the cat's visual cortex. , 1996, Journal of neurophysiology.

[54]  Jerry D. Nguyenkim,et al.  Disparity-Based Coding of Three-Dimensional Surface Orientation by Macaque Middle Temporal Neurons , 2003, The Journal of Neuroscience.

[55]  Thaddeus B. Czuba,et al.  Three-dimensional motion aftereffects reveal distinct direction-selective mechanisms for binocular processing of motion through depth. , 2011, Journal of vision.

[56]  R. Andersen,et al.  Transparent motion perception as detection of unbalanced motion signals. II. Physiology , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[57]  G. Orban,et al.  Shape and Spatial Distribution of Receptive Fields and Antagonistic Motion Surrounds in the Middle Temporal Area (V5) of the Macaque , 1995, The European journal of neuroscience.

[58]  R. Andersen,et al.  Integration of motion and stereopsis in middle temporal cortical area of macaques , 1995, Nature.

[59]  Fabio Solari,et al.  Emergence of motion-in-depth selectivity in the visual cortex through linear combination of binocular energy complex cells with different ocular dominance , 2004, Neurocomputing.

[60]  Thaddeus B. Czuba,et al.  Motion processing with two eyes in three dimensions. , 2011, Journal of vision.

[61]  D Regan,et al.  The relation between discrimination and sensitivity in the perception of motion in depth. , 1975, The Journal of physiology.

[62]  Maneesh Sahani,et al.  How Linear are Auditory Cortical Responses? , 2002, NIPS.

[63]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[64]  Julie M. Harris,et al.  Binocular vision and motion-in-depth. , 2008, Spatial vision.

[65]  R. M. Siegel,et al.  Analysis of optic flow in the monkey parietal area 7a. , 1997, Cerebral cortex.

[66]  Leslie G. Ungerleider,et al.  Cortical connections of visual area MT in the macaque , 1986, The Journal of comparative neurology.

[67]  R. Desimone,et al.  Columnar organization of directionally selective cells in visual area MT of the macaque. , 1984, Journal of neurophysiology.

[68]  D. Heeger,et al.  Neuronal Basis of the Motion Aftereffect Reconsidered , 2001, Neuron.