A support system for visually impaired persons to understand three-dimensional visual information using acoustic interface

Visual information processing technology is very important in the implementation for sensory substitution of visually impaired persons as well as applications to factory automation. This paper outlines the design of a visual support system that provides 3D visual information using 3D virtual sounds. Three-dimensional information, such as distance map, object recognition, and object tracking required for the visually impaired user is obtained by analyzing images captured by stereo cameras. Using a 3D virtual acoustic display, which relies on Head Related Transfer Functions (HRTFs), the user is informed of the locations and movements of objects. The user's external auditory sense is not impeded as the system uses bone conduction headphones which do not block out environment sounds. The proposed system is expected to be useful in the situations where the infrastructure is incomplete and the situation changes in realtime. We plan experiments using this system to guide users while walking and playing sports.

[1]  Yoshihiro Kawai,et al.  Recognition of 3D free-form objects using segment-based stereo vision , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[2]  T. Ifukube,et al.  A blind mobility aid modeled after echolocation of bats , 1991, IEEE Transactions on Biomedical Engineering.

[3]  K. Koshi,et al.  Orientation aids for the blind using ultrasonic signpost system , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[4]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[5]  Fumiaki Tomita,et al.  3-D Motion Tracking of 3-D Objects Using Stereo Vision. , 2000 .

[6]  E. R. Strelow,et al.  Electronic Spatial Sensing for the Blind , 1985 .

[7]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.

[8]  Yoshihiro Kawai,et al.  Stereo correspondence using segment connectivity , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).