Tactile feedback improves auditory spatial localization

Our recent studies suggest that congenitally blind adults have severely impaired thresholds in an auditory spatial bisection task, pointing to the importance of vision in constructing complex auditory spatial maps (Gori et al., 2014). To explore strategies that may improve the auditory spatial sense in visually impaired people, we investigated the impact of tactile feedback on spatial auditory localization in 48 blindfolded sighted subjects. We measured auditory spatial bisection thresholds before and after training, either with tactile feedback, verbal feedback, or no feedback. Audio thresholds were first measured with a spatial bisection task: subjects judged whether the second sound of a three sound sequence was spatially closer to the first or the third sound. The tactile feedback group underwent two audio-tactile feedback sessions of 100 trials, where each auditory trial was followed by the same spatial sequence played on the subject’s forearm; auditory spatial bisection thresholds were evaluated after each session. In the verbal feedback condition, the positions of the sounds were verbally reported to the subject after each feedback trial. The no feedback group did the same sequence of trials, with no feedback. Performance improved significantly only after audio-tactile feedback. The results suggest that direct tactile feedback interacts with the auditory spatial localization system, possibly by a process of cross-sensory recalibration. Control tests with the subject rotated suggested that this effect occurs only when the tactile and acoustic sequences are spatially congruent. Our results suggest that the tactile system can be used to recalibrate the auditory sense of space. These results encourage the possibility of designing rehabilitation programs to help blind persons establish a robust auditory sense of space, through training with the tactile modality.

[1]  Amir Amedi,et al.  Visual Cortex Extrastriate Body-Selective Area Activation in Congenitally Blind People “Seeing” by Using Sounds , 2014, Current Biology.

[2]  G. Sandini,et al.  Impairment of auditory spatial localization in congenitally blind human subjects , 2013, Brain : a journal of neurology.

[3]  Monica Gori,et al.  Impaired visual size-discrimination in children with movement disorders , 2012, Neuropsychologia.

[4]  G. Sandini,et al.  Development of Visuo-Auditory Integration in Space and Time , 2012, Front. Integr. Neurosci..

[5]  David Whitney,et al.  Ultrafine spatial acuity of blind expert human echolocators , 2012, Experimental Brain Research.

[6]  M. Goodale,et al.  Citation for Published Item: Use Policy Neural Correlates of Natural Human Echolocation in Early and Late Blind Echolocation Experts , 2022 .

[7]  G. Sandini,et al.  Poor Haptic Orientation Discrimination in Nonsighted Children May Reflect Disruption of Cross-Sensory Calibration , 2010, Current Biology.

[8]  David C. Burr,et al.  Young Children Do Not Integrate Visual and Haptic Form Information , 2008, Current Biology.

[9]  Jörg Lewald,et al.  More accurate sound localization induced by short-term light deprivation , 2007, Neuropsychologia.

[10]  A. Vanlierde,et al.  Specific activation of the V5 brain area by auditory motion processing: an fMRI study. , 2005, Brain research. Cognitive brain research.

[11]  Laurent Renier,et al.  Cognitive and brain mechanisms in sensory substitution of vision: a contribution to the study of human perception. , 2005, Journal of integrative neuroscience.

[12]  R. Zatorre,et al.  A Functional Neuroimaging Study of Sound Localization: Visual Cortex Activity Predicts Performance in Early-Blind Individuals , 2005, PLoS biology.

[13]  S. Resnikoff,et al.  Global data on visual impairment in the year 2002. , 2004, Bulletin of the World Health Organization.

[14]  R. Zatorre,et al.  Fisheries: Mislabelling of a depleted reef fish , 2004, Nature.

[15]  David Alais,et al.  No direction-specific bimodal facilitation for audiovisual motion detection. , 2004, Brain research. Cognitive brain research.

[16]  P. Bach-y-Rita,et al.  Sensory substitution and the human–machine interface , 2003, Trends in Cognitive Sciences.

[17]  Masahiko Inami,et al.  SmartTouch - augmentation of skin sensation with electrocutaneous display , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[18]  A. John Van Opstal,et al.  Plasticity in human sound localization induced by compressed spatial vision , 2003, Nature Neuroscience.

[19]  Matthias M. Müller,et al.  Expansion of the Tonotopic Area in the Auditory Cortex of the Blind , 2002, The Journal of Neuroscience.

[20]  A. Smit,et al.  Synapse Formation between Central Neurons Requires Postsynaptic Expression of the MEN1 Tumor Suppressor Gene , 2001, The Journal of Neuroscience.

[21]  M. P. Zwiers,et al.  A Spatial Hearing Deficit in Early-Blind Humans , 2001, The Journal of Neuroscience.

[22]  J. Rauschecker,et al.  A Positron Emission Tomographic Study of Auditory Localization in the Congenitally Blind , 2000, The Journal of Neuroscience.

[23]  A J King,et al.  Improved auditory spatial acuity in visually deprived ferrets , 1999, The European journal of neuroscience.

[24]  S. Hillyard,et al.  Improved auditory spatial tuning in blind humans , 1999, Nature.

[25]  P. Bach-y-Rita,et al.  Form perception with a 49-point electrotactile stimulus array on the tongue: a technical note. , 1998, Journal of rehabilitation research and development.

[26]  C. Trullemans,et al.  A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution , 1998, IEEE Transactions on Biomedical Engineering.

[27]  M. Paré,et al.  Early-blind human subjects localize sound sources better than sighted subjects , 1998, Nature.

[28]  G. Recanzone.  Rapidly induced auditory plasticity: the ventriloquism aftereffect. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Paul Bach-y-Rita,et al.  Tactile displays , 1995 .

[30]  J. Rauschecker,et al.  Auditory spatial tuning of cortical neurons is sharpened in cats with early blindness. , 1993, Journal of neurophysiology.

[31]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[32]  E I Knudsen,et al.  Visual instruction of the neural map of auditory space in the developing optic tectum. , 1991, Science.

[33]  C. Blakemore,et al.  Developmental plasticity in the visual and auditory representations in the mammalian superior colliculus , 1988, Nature.

[34]  S. Mateeff,et al.  Dynamic Visual Capture: Apparent Auditory Motion Induced by a Moving Visual Target , 1985, Perception.

[35]  E I Knudsen,et al.  Vision guides the adjustment of auditory localization in young barn owls. , 1985, Science.

[36]  A. Watson,et al.  Quest: A Bayesian adaptive psychometric method , 1983, Perception & psychophysics.

[37]  D. H. Warren,et al.  The role of visual-auditory “compellingness” in the ventriloquism effect: Implications for transitivity among the spatial senses , 1981, Perception & psychophysics.

[38]  Jennifer L. Milne,et al.  Neural correlates of motion processing through echolocation, source hearing, and vision in blind echolocation experts and sighted echolocation novices. , 2014, Journal of neurophysiology.

[39]  Monica Gori,et al.  Tactile feedback improves auditory spatial localization , 2014, Front. Psychol..

[40]  D. Burr,et al.  Multisensory Integration Develops Late in Humans , 2012 .

[41]  M. Wallace,et al.  Early experience determines how the senses will interact. , 2007, Journal of neurophysiology.

[42]  M. Lassonde,et al.  Blind subjects process auditory spectral cues more efficiently than sighted individuals , 2004, Experimental Brain Research.

[43]  S. Carlile,et al.  Changes induced in the representation of auditory space in the superior colliculus by rearing ferrets with binocular eyelid suture , 2004, Experimental Brain Research.