A Normalization Mechanism for Estimating Visual Motion across Speeds and Scales

Interacting with the natural environment leads to complex stimulations of our senses. Here we focus on the estimation of visual speed, a critical source of information for the survival of many animal species as they monitor moving prey or approaching dangers. In mammals, and in particular in primates, speed information is conceived to be represented by a set of channels sensitive to different spatial and temporal characteristics of the optic flow [1-5]. However, it is still largely unknown how the brain accurately infers the speed of complex natural scenes from this set of spatiotemporal channels [6-14]. As complex stimuli, we chose a set of well-controlled moving naturalistic textures called "compound motion clouds" (CMCs) [15, 16] that simultaneously activate multiple spatiotemporal channels. We found that CMC stimuli that have the same physical speed are perceived moving at different speeds depending on which channel combinations are activated. We developed a computational model demonstrating that the activity in a given channel is both boosted and weakened after a systematic pattern over neighboring channels. This pattern of interactions can be understood as a combination of two components oriented in speed (consistent with a slow-speed prior) and scale (sharpening of similar features). Interestingly, the interaction along scale implements a lateral inhibition mechanism, a canonical principle that hitherto was found to operate mainly in early sensory processing. Overall, the speed-scale normalization mechanism may reflect the natural tendency of the visual system to integrate complex inputs into one coherent percept.

[1]  Justin L. Gardner,et al.  Cortical Correlates of Human Motion Perception Biases , 2014, The Journal of Neuroscience.

[2]  Anthony J. Movshon,et al.  Optimal representation of sensory information by neural populations , 2006, Nature Neuroscience.

[3]  Masahiro Takei,et al.  Human resource development and visualization , 2009, J. Vis..

[4]  Guillaume S Masson,et al.  Motion clouds: model-based stimulus synthesis of natural-like random textures for the study of motion perception. , 2012, Journal of neurophysiology.

[5]  D. Ruderman,et al.  Independent component analysis of natural image sequences yields spatio-temporal filters similar to simple cells in primary visual cortex , 1998, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[6]  H. K. Hartline,et al.  INHIBITION IN THE EYE OF LIMULUS , 1956, The Journal of general physiology.

[7]  S. McKee,et al.  Precise velocity discrimination despite random variations in temporal frequency and contrast , 1986, Vision Research.

[8]  Alan Johnston,et al.  Asymmetric global motion integration in drifting Gabor arrays. , 2014, Journal of vision.

[9]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[10]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .

[11]  C. Blakemore,et al.  Lateral inhibition between orientation detectors in the cat's visual cortex , 2004, Experimental Brain Research.

[12]  Andrew B. Watson,et al.  A look at motion in the frequency domain , 1983 .

[13]  Alan A. Stocker,et al.  Signal Integration in Human Visual Speed Perception , 2015, The Journal of Neuroscience.

[14]  Jonathan Vacher,et al.  Biologically Inspired Dynamic Textures for Probing Motion Perception , 2015, NIPS.

[15]  P. Thompson Perceived rate of movement depends on contrast , 1982, Vision Research.

[16]  Pascal Mamassian,et al.  More is not always better: adaptive gain control explains dissociation between perception and action , 2012, Nature Neuroscience.

[17]  G M Shepherd,et al.  Dendrodendritic synaptic pathway for inhibition in the olfactory bulb. , 1966, Experimental neurology.

[18]  Merav Ahissar,et al.  Contradictory Behavioral Biases Result from the Influence of Past Stimuli on Perception , 2014, PLoS Comput. Biol..

[19]  T. Meese,et al.  Spatial and temporal dependencies of cross-orientation suppression in human vision , 2007, Proceedings of the Royal Society B: Biological Sciences.

[20]  Richard E. Turner,et al.  A Structured Model of Video Reproduces Primary Visual Cortical Organisation , 2009, PLoS Comput. Biol..

[21]  M. Carandini,et al.  Normalization as a canonical neural computation , 2013, Nature Reviews Neuroscience.

[22]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[23]  J. Perrone A Single Mechanism Can Explain the Speed Tuning Properties of MT and V1 Complex Neurons , 2006, The Journal of Neuroscience.

[24]  Eero P. Simoncelli,et al.  A model of neuronal responses in visual area MT , 1998, Vision Research.

[25]  Christopher C. Pack,et al.  Contrast dependence of suppressive influences in cortical area MT of alert macaque. , 2005, Journal of neurophysiology.

[26]  Peter Thompson,et al.  Perceived speed in peripheral vision can go up or down. , 2016, Journal of vision.

[27]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[28]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  Nicholas J. Priebe,et al.  The Neural Representation of Speed in Macaque Area MT/V5 , 2003, The Journal of Neuroscience.

[30]  Nicholas J. Priebe,et al.  Tuning for Spatiotemporal Frequency and Speed in Directionally Selective Neurons of Macaque Striate Cortex , 2006, The Journal of Neuroscience.

[31]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[32]  Shihab A. Shamma,et al.  Patterns of inhibition in auditory cortical cells in awake squirrel monkeys , 1985, Hearing Research.

[33]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[34]  E. P. Gardner,et al.  Sensory funneling. II. Cortical neuronal representation of patterned cutaneous stimuli. , 1972, Journal of neurophysiology.

[35]  O E Favreau,et al.  Perceived velocity of moving chromatic gratings. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[36]  T. Meese,et al.  Cross-orientation masking is speed invariant between ocular pathways but speed dependent within them. , 2009, Journal of vision.

[37]  J. Perrone A neural-based code for computing image velocity from small sets of middle temporal (MT/V5) neuron inputs. , 2012, Journal of vision.

[38]  Shin'ya Nishida,et al.  Multiple-stage ambiguity in motion perception reveals global computation of local motion directions. , 2016, Journal of vision.

[39]  Nicholas J. Priebe,et al.  Estimating Target Speed from the Population Response in Visual Area MT , 2004, The Journal of Neuroscience.

[40]  Pascal Mamassian,et al.  Speed channel interactions in naturalistic motion stimuli , 2016 .

[41]  Alexander Thiele,et al.  A model of speed tuning in MT neurons , 2002, Vision Research.

[42]  E. Wist,et al.  The spatial frequency effect on perceived velocity , 1976, Vision Research.

[43]  Andrew Isaac Meso,et al.  Towards an understanding of the roles of visual areas MT and MST in computing speed , 2014, Front. Comput. Neurosci..

[44]  Peter Thompson,et al.  Contrast and stimulus complexity moderate the relationship between spatial frequency and perceived speed: implications for MT models of speed perception. , 2011, Journal of vision.

[45]  Alan L. F. Lee,et al.  A comparison of global motion perception using a multiple-aperture stimulus. , 2010, Journal of vision.

[46]  G. Orban,et al.  The spatial distribution of the antagonistic surround of MT/V5 neurons. , 1997, Cerebral cortex.

[47]  A. T. Smith,et al.  The influence of spatial frequency on perceived temporal frequency and perceived speed , 1990, Vision Research.

[48]  Eero P. Simoncelli Local analysis of visual motion , 2003 .

[49]  Omar Hassan,et al.  Perceptual biases are inconsistent with Bayesian encoding of speed in the human visual system. , 2015, Journal of vision.

[50]  Alexander Thiele,et al.  Speed skills: measuring the visual speed analyzing properties of primate MT neurons , 2001, Nature Neuroscience.

[51]  Rebecca A. Champion,et al.  A ratio model of perceived speed in the human visual system , 2005, Proceedings of the Royal Society B: Biological Sciences.

[52]  Angela Jianu,et al.  Schlieren and “focused” shadowgraphy visualization of the shape and wake of single air bubbles freely rising in quiescent water , 2007, J. Vis..

[53]  Eero P. Simoncelli,et al.  Optimal inference explains the perceptual coherence of visual motion stimuli. , 2011, Journal of vision.

[54]  M. Turatto,et al.  Attention makes moving objects be perceived to move faster , 2007, Vision Research.

[55]  Frederick A A Kingdom,et al.  Comparison of sensitivity to color changes in natural and phase-scrambled scenes. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[56]  Aya Takemura,et al.  MST neurons code for visual motion in space independent of pursuit eye movements. , 2007, Journal of neurophysiology.