Lawful tracking of visual motion in humans, macaques, and marmosets in a naturalistic, continuous, and untrained behavioral context

Significance We characterize spatiotemporal integration of naturalistic, continuous visual motion of three primate species (humans, macaques, and marmosets). All three species volitionally, but naturally, track the center of expansion of a dynamic optic flow field. Detailed analysis of this flow-tracking behavior reveals lawful and repeatable dependencies of the behavior on nuances in the stimulus, revealing that even unconstrained and continuous behavior can exhibit the sort of precise dependencies typically studied only in artificial and constrained tasks. Much study of the visual system has focused on how humans and monkeys integrate moving stimuli over space and time. Such assessments of spatiotemporal integration provide fundamental grounding for the interpretation of neurophysiological data, as well as how the resulting neural signals support perceptual decisions and behavior. However, the insights supported by classical characterizations of integration performed in humans and rhesus monkeys are potentially limited with respect to both generality and detail: Standard tasks require extensive amounts of training, involve abstract stimulus–response mappings, and depend on combining data across many trials and/or sessions. It is thus of concern that the integration observed in classical tasks involves the recruitment of brain circuits that might not normally subsume natural behaviors, and that quantitative analyses have limited power for characterizing single-trial or single-session processes. Here we bridge these gaps by showing that three primate species (humans, macaques, and marmosets) track the focus of expansion of an optic flow field continuously and without substantial training. This flow-tracking behavior was volitional and reflected substantial temporal integration. Most strikingly, gaze patterns exhibited lawful and nuanced dependencies on random perturbations in the stimulus, such that repetitions of identical flow movies elicited remarkably similar eye movements over long and continuous time periods. These results demonstrate the generality of spatiotemporal integration in natural vision, and offer a means for studying integration outside of artificial tasks while maintaining lawful and highly reliable behavior.

[1]  F. A. Miles,et al.  Short-latency ocular following responses of monkey. I. Dependence on temporospatial properties of visual input. , 1986, Journal of neurophysiology.

[2]  Miriam Spering,et al.  Contextual effects on motion perception and smooth pursuit eye movements , 2008, Brain Research.

[3]  Guillaume S Masson,et al.  Motion clouds: model-based stimulus synthesis of natural-like random textures for the study of motion perception. , 2012, Journal of neurophysiology.

[4]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[5]  K. Hoffmann,et al.  Optokinetic eye movements elicited by radial optic flow in the macaque monkey. , 1998, Journal of neurophysiology.

[6]  John H. Reynolds,et al.  Active Vision in Marmosets: A Model System for Visual Neuroscience , 2014, The Journal of Neuroscience.

[7]  James A. Crowell,et al.  Ideal observer for heading judgments , 1996, Vision Research.

[8]  J. Movshon,et al.  Adaptive Temporal Integration of Motion in Direction-Selective Neurons in Macaque Visual Cortex , 2004, The Journal of Neuroscience.

[9]  S G Lisberger,et al.  Neuronal responses in visual areas MT and MST during smooth pursuit target selection. , 1997, Journal of neurophysiology.

[10]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[11]  Alexander Huk,et al.  PLDAPS: A Hardware Architecture and Software Toolbox for Neurophysiology Requiring Complex Visual Stimuli and Online Behavioral Control , 2012, Front. Neuroinform..

[12]  Johannes Burge,et al.  Continuous psychophysics: Target-tracking to measure visual sensitivity. , 2015, Journal of vision.

[13]  K. Hoffmann Neural Basis for Changes of the Optokinetic Reflex in Animals and Men with Strabismus and Amblyopia , 1988 .

[14]  Natasha Merat,et al.  The need for speed: global optic flow speed influences steering , 2016, Royal Society Open Science.

[15]  D. L. Adams,et al.  A biocompatible titanium headpost for stabilizing behaving monkeys. , 2007, Journal of neurophysiology.

[16]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[17]  D. Tank,et al.  Imaging Large-Scale Neural Activity with Cellular Resolution in Awake, Mobile Mice , 2007, Neuron.

[18]  Maneesh Sahani,et al.  Evidence Optimization Techniques for Estimating Stimulus-Response Functions , 2002, NIPS.

[19]  J. Gallant,et al.  A Three-Dimensional Spatiotemporal Receptive Field Model Explains Responses of Area MT Neurons to Naturalistic Movies , 2011, The Journal of Neuroscience.

[20]  Simon Barthelmé,et al.  Spatial statistics and attentional dynamics in scene viewing. , 2014, Journal of vision.

[21]  C. Duffy,et al.  Cortical neuronal responses to optic flow are shaped by visual strategies for steering. , 2008, Cerebral cortex.

[22]  George A. Alvarez,et al.  Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model , 2009, NIPS.

[23]  Mijung Park,et al.  Receptive Field Inference with Localized Priors , 2011, PLoS Comput. Biol..

[24]  John H. R. Maunsell,et al.  Visual processing in monkey extrastriate cortex. , 1987, Annual review of neuroscience.

[25]  John M. Franchak,et al.  Free Viewing Gaze Behavior in Infants and Adults. , 2016, Infancy : the official journal of the International Society on Infant Studies.

[26]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[27]  D. Bradley,et al.  Structure and function of visual area MT. , 2005, Annual review of neuroscience.

[28]  Wilson S. Geisler,et al.  Optimal eye movement strategies in visual search , 2005, Nature.

[29]  R. Gregory The Most Expensive Painting in the World , 2007, Perception.

[30]  Felix A. Wichmann,et al.  Rapid animal detection in natural scenes: Critical features are local , 2010 .

[31]  Cory T. Miller,et al.  Motion dependence of smooth pursuit eye movements in the marmoset. , 2015, Journal of neurophysiology.

[32]  Lawrence K. Cormack,et al.  Reflexive and voluntary control of smooth eye movements , 2013, Electronic Imaging.

[33]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.