Self-operated stimuli improve subsequent visual motion processing

Proper interpretation of visual information requires capturing the structural regularities in the visual signal and this frequently occurs in conjunction with movement. Perceptual interpretation is complicated both by transient perceptual changes that accompany motor activity, and as found in audition and somatosensation, by more persistent changes that accompany the learning of new movements. Here we asked whether motor learning also results in sustained changes to visual perception. We designed a reaching task in which participants directly controlled the visual information they received, which we term self-operated stimuli. Specifically, they trained to make movements in a number of directions. Directional information was provided by the motion of an intrinsically ambiguous moving stimulus which was directly tied to motion of the hand. We find that movement training improves perception of coherent stimulus motion, and that changes in movement are correlated with the perceptual change. No perceptual changes are observed in passive observers even when they are provided with an explicit strategy to solve perceptual grouping. Comparison of empirical perceptual data with simulations based on a Bayesian generative model of motion perception suggests that movement training promotes the fine-tuning of the internal representation of stimulus geometry. These results emphasize the role of sensorimotor interaction in determining the persistent properties in space and time that define a percept.

[1]  N. Prins The psi-marginal adaptive method: How to give nuisance parameters the attention they deserve (no more, no less). , 2013, Journal of vision.

[2]  Melvyn A Goodale,et al.  Motor Force Field Learning Influences Visual Processing of Target Motion , 2007, The Journal of Neuroscience.

[3]  Duje Tadin,et al.  Disentangling locus of perceptual learning in the visual hierarchy of motion processing , 2018, Scientific Reports.

[4]  D. Henriques,et al.  Sensory recalibration of hand position following visuomotor adaptation. , 2009, Journal of neurophysiology.

[5]  E. Adelson,et al.  Phenomenal coherence of moving visual patterns , 1982, Nature.

[6]  Jonathan W. Pillow,et al.  Single-trial spike trains in parietal cortex reveal discrete steps during decision-making , 2015, Science.

[7]  J. B. Mulligan,et al.  Effect of contrast on the perceived direction of a moving plaid , 1990, Vision Research.

[8]  M. Carandini,et al.  Testing the Bayesian model of perceived speed , 2002, Vision Research.

[9]  Dale Purves,et al.  An empirical explanation of aperture effects , 2009, Proceedings of the National Academy of Sciences.

[10]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[11]  T. Albright,et al.  Motion coherency rules are form-cue invariant , 1992, Vision Research.

[12]  H. Wilson,et al.  Perceived direction of moving two-dimensional patterns , 1990, Vision Research.

[13]  W. Prinz,et al.  Seeing while moving: Measuring the online influence of action on perception , 2007, Quarterly journal of experimental psychology.

[14]  Hans Wallach Über visuell wahrgenommene Bewegungsrichtung , 1935 .

[15]  J. Krakauer,et al.  Human sensorimotor learning: adaptation, skill, and beyond , 2011, Current Opinion in Neurobiology.

[16]  Denis G. Pelli,et al.  ECVP '07 Abstracts , 2007, Perception.

[17]  Nava Rubin,et al.  The oblique plaid effect , 2004, Vision Research.

[18]  A. Wohlschläger,et al.  Visual motion priming by invisible actions , 2000, Vision Research.

[19]  Sethu Vijayakumar,et al.  Unifying the Sensory and Motor Components of Sensorimotor Adaptation , 2008, NIPS.

[20]  Marianna Semprini,et al.  Consolidation of human somatosensory memory during motor learning , 2018, Behavioural Brain Research.

[21]  Eero P. Simoncelli,et al.  Noise characteristics and prior expectations in human visual speed perception , 2006, Nature Neuroscience.

[22]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[23]  C. S. Harris Adaptation to Displaced Vision: Visual, Motor, or Proprioceptive Change? , 1963, Science.

[24]  Rebecca A. Champion,et al.  Perceived direction of plaid motion is not predicted by component speeds , 2007, Vision Research.

[25]  R. Held,et al.  MOVEMENT-PRODUCED STIMULATION IN THE DEVELOPMENT OF VISUALLY GUIDED BEHAVIOR. , 1963, Journal of comparative and physiological psychology.

[26]  W. Einhäuser,et al.  Cognition modulates action-to-perception transfer in ambiguous perception. , 2018, Journal of vision.

[27]  Jeremy D Wong,et al.  Somatosensory Plasticity and Motor Learning , 2010, The Journal of Neuroscience.

[28]  Iseult A. M. Beets,et al.  Nonvisual motor learning improves visual motion perception: evidence from violating the two-thirds power law. , 2010, Journal of neurophysiology.

[29]  Dennis M. Levi A new Editor-in-Chief for Journal of Vision , 2013 .

[30]  P. A. Beckett Development of the third component in prism adaptation: effects of active and passive movement. , 1980, Journal of experimental psychology. Human perception and performance.

[31]  Jeounghoon Kim,et al.  Dependence of plaid motion coherence on component grating directions , 1993, Vision Research.

[32]  C. Tyler,et al.  Bayesian adaptive estimation of psychometric slope and threshold , 1999, Vision Research.

[33]  W. Prinz,et al.  Perceptual resonance: action-induced modulation of perception , 2007, Trends in Cognitive Sciences.

[34]  Eero P. Simoncelli,et al.  Optimal inference explains the perceptual coherence of visual motion stimuli. , 2011, Journal of vision.

[35]  Zijiang J. He,et al.  Seeing grating-textured surface begins at the border. , 2011, Journal of vision.

[36]  T. D. Albright,et al.  Transparency and coherence in human motion perception , 1990, Nature.

[37]  A. Wohlschläger Mental object rotation and the planning of hand movements , 2001, Perception & psychophysics.

[38]  T D Albright,et al.  Visual motion perception. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Edward H. Adelson,et al.  Motion illusions as optimal percepts , 2002, Nature Neuroscience.

[40]  Hannah J. Block,et al.  Somatosensory changes associated with motor skill learning. , 2020, Journal of neurophysiology.

[41]  Andrew A G Mattar,et al.  Motor learning and its sensory effects: time course of perceptual change and its presence with gradual introduction of load. , 2013, Journal of neurophysiology.

[42]  T. Milner,et al.  Functionally Specific Changes in Resting-State Sensorimotor Networks after Motor Learning , 2011, The Journal of Neuroscience.

[43]  Fulvio Domini,et al.  Visuomotor Adaptation Changes Stereoscopic Depth Perception and Tactile Discrimination , 2013, The Journal of Neuroscience.

[44]  C. Law,et al.  Neural correlates of perceptual learning in a sensory-motor, but not a sensory, cortical area , 2008, Nature Neuroscience.

[45]  D R Badcock,et al.  Motion coherence across different chromatic axes. , 1996, Vision research.

[46]  D. Purves,et al.  How biological vision succeeds in the physical world , 2014, Proceedings of the National Academy of Sciences.