SoundView: An auditory guidance system based on environment understanding for the visually impaired people

Without visual information, the blind people live in various hardships with shopping, reading, finding objects and etc. Therefore, we developed a portable auditory guide system, called SoundView, for visually impaired people. This prototype system consists of a mini-CCD camera, a digital signal processing unit and an earphone, working with built-in customizable auditory coding algorithms. Employing environment understanding techniques, SoundView processes the images from a camera and detects objects tagged with barcodes. The recognized objects in the environment are then encoded into stereo speech signals for the blind though an earphone. The user would be able to recognize the type, motion state and location of the interested objects with the help of SoundView. Compared with other visual assistant techniques, SoundView is object-oriented and has the advantages of cheap cost, smaller size, light weight, low power consumption and easy customization.

[1]  Marie-Chantal Wanet-Defalque,et al.  Auditory substitution of vision: pattern recognition by the blind , 2001 .

[2]  C. Trullemans,et al.  A real-time experimental prototype for enhancement of vision rehabilitation using auditory substitution , 1998, IEEE Transactions on Biomedical Engineering.

[3]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[4]  N. Bruno,et al.  Perceiving occlusion through auditory–visual substitution , 2006, Cognitive Processing.

[5]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[6]  P. Bach-y-Rita.  Brain mechanisms in sensory substitution , 1972 .

[7]  K. Palomäki,et al.  Spatial processing in human auditory cortex: the effects of 3D, ITD, and ILD stimulation techniques. , 2005, Brain research. Cognitive brain research.

[8]  Johann Borenstein,et al.  The NavBelt - A Computerized Multi-Sensor Travel Aid for Active Guidance of the Blind , 1990 .

[9]  Yoshihiro Kawai,et al.  A support system for visually impaired persons to understand three-dimensional visual information using acoustic interface , 2002, Object recognition supported by user interaction for service robots.

[10]  John A. Brabyn,et al.  Mobility Aids for the Blind , 1982, Engineering in Medicine and Biology Magazine.