Cross-sensory transfer of sensory-motor information: visuomotor learning affects performance on an audiomotor task, using sensory-substitution

Visual-to-auditory sensory-substitution devices allow users to perceive a visual image using sound. Using a motor-learning task, we found that new sensory-motor information was generalized across sensory modalities. We imposed a rotation when participants reached to visual targets, and found that not only seeing, but also hearing the location of targets via a sensory-substitution device resulted in biased movements. When the rotation was removed, aftereffects occurred whether the location of targets was seen or heard. Our findings demonstrate that sensory-motor learning was not sensory-modality-specific. We conclude that novel sensory-motor information can be transferred between sensory modalities.

[1]  Masaya Hirashima,et al.  Asymmetric Transfer of Visuomotor Learning between Discrete and Rhythmic Movements , 2010, The Journal of Neuroscience.

[2]  Jung-Kyong Kim,et al.  Can you hear shapes you touch? , 2010, Experimental Brain Research.

[3]  Britne A. Shabbott,et al.  Learning a visuomotor rotation: simultaneous visual and proprioceptive information is crucial for visuomotor remapping , 2010, Experimental Brain Research.

[4]  Carter C. Collins,et al.  Tactile Television - Mechanical and Electrical Image Projection , 1970 .

[5]  William M. Stern,et al.  Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex , 2007, Nature Neuroscience.

[6]  N. Guttman,et al.  Discriminability and stimulus generalization. , 1956, Journal of experimental psychology.

[7]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[8]  C Ghez,et al.  Learning of Visuomotor Transformations for Vectorial Planning of Reaching Trajectories , 2000, The Journal of Neuroscience.

[9]  E. Vaadia,et al.  Preparatory activity in motor cortex reflects learning of local visuomotor skills , 2003, Nature Neuroscience.

[10]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[11]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[12]  Eilon Vaadia,et al.  Just Do It: Action-Dependent Learning Allows Sensory Prediction , 2011, PloS one.

[13]  S Levy-Tzedek,et al.  Fast, accurate reaching movements with a visual-to-auditory sensory substitution device. , 2012, Restorative neurology and neuroscience.

[14]  K. An,et al.  Functional ranges of motion of the wrist joint. , 1991, The Journal of hand surgery.

[15]  T. Stanford,et al.  Multisensory Integration Shortens Physiological Response Latencies , 2007, The Journal of Neuroscience.

[16]  Amir Amedi,et al.  ‘Visual’ Acuity of the Congenitally Blind Using Visual-to-Auditory Sensory Substitution , 2012, PloS one.