Development of a New Space Perception System for Blind People, Based on the Creation of a Virtual Acoustic Space

The aim of the project is to give blind people more information about their immediate environment than they get using traditional methods. We have developed a device which captures the form and the volume of the space in front of the blind person and sends this information, in the form of a sounds map, to the blind person through headphones in real time. The effect produced is comparable to perceiving the environment as if the objects were covered with small sound sources which are continuously and simultaneously emitting signals. An experimental working prototype has been developed, which has allowed us to validate the idea that it is possible to perceive the spatial characteristics of the environment. The validation experiments have been carried out with the collaboration of blind people and to a large extent, the sound perception of the environment has been accompanied by simultaneous visual evocation, this being the visualisation of luminous points (phophenes) located at the same positions as the virtual sound sources.

[1]  J. Rauschecker Compensatory plasticity and sensory substitution in the cerebral cortex , 1995, Trends in Neurosciences.

[2]  H Summala,et al.  Neural plasticity in processing of sound location by the early blind: an event-related potential study. , 1992, Electroencephalography and clinical neurophysiology.

[3]  BENJAMIN WHITE,et al.  Vision Substitution by Tactile Image Projection , 1969, Nature.

[4]  I. Rock The nature of perceptual adaptation , 1969 .

[5]  F L Wightman,et al.  Headphone simulation of free-field listening. II: Psychophysical validation. , 1989, The Journal of the Acoustical Society of America.

[6]  H Summala,et al.  Auditory processing in visual brain areas of the early blind: evidence from event-related potentials. , 1993, Electroencephalography and clinical neurophysiology.

[7]  A. Volder,et al.  Glucose utilization in human visual cortex is abnormally elevated in blindness of early onset but decreased in blindness of late onset , 1990, Brain Research.

[8]  Leslie Kay,et al.  Air Sonars with Acoustical Display of Spatial Information , 1980 .

[9]  J. Rauschecker,et al.  Auditory compensation for early blindness in cat cerebral cortex , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  David Nitzan,et al.  Three-Dimensional Vision Structure for Robot Applications , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  M D Sanders,et al.  Auditory evoked phosphenes in optic nerve disease , 1982, Journal of neurology, neurosurgery, and psychiatry.

[12]  M. Hallett,et al.  Activation of the primary visual cortex by Braille reading in blind subjects , 1996, Nature.

[13]  C H Keller,et al.  Representation of multiple sound sources in the owl's auditory space map , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  P Hawrylyshyn,et al.  Visual phenomena evoked by electrical stimulation of the human brain stem. , 1980, Applied neurophysiology.

[15]  R. Andersen,et al.  Multimodal representation of space in the posterior parietal cortex and its use in planning movements. , 1997, Annual review of neuroscience.

[16]  D. Winfield The postnatal development of synapses in the visual cortex of the cat and the effects of eyelid closure , 1981, Brain Research.

[17]  S. Clarke,et al.  Bilateral transitory projection to visual areas from auditory cortex in kittens. , 1984, Brain research.

[18]  M M Cohen,et al.  Phosphenes induced by sound , 1979, Neurology.

[19]  Richard S. J. Frackowiak,et al.  Right parietal cortex is involved in the perception of sound movement in humans , 1998, Nature Neuroscience.