A Visual Support System for Visually Impaired Persons Using Acoustic Interface

ly by infrastructure maintenance and development. In this paper, we outline the design of a visual support system that provides three-dimensional visual information using three-dimensional virtual sound. Three-dimensional information is obtained by analyzing images captured by stereo cameras, and recognizing the objects needed by the visually impaired user. Using the three-dimensional virtual acoustic display, which relies on Head Related Transfer Functions, the user is informed of the 1ocations and movements of objects. The user's auditory sense is not impeded as we use a bone conduction headset, which does not block out environmental sound. The proposed system is expected to be useful in the situation where the infrastructure is incomplete, and when the situation changes in realtime. We plan to experiment with it, for example, to guide users in walking and playing sports.

[1]  E. R. Strelow,et al.  Electronic Spatial Sensing for the Blind , 1985 .

[2]  Peter B. L. Meijer,et al.  An experimental system for auditory image representations , 1992, IEEE Transactions on Biomedical Engineering.

[3]  Yoshihiro Kawai,et al.  Recognition of 3D free-form objects using segment-based stereo vision , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[4]  Peter Gorny,et al.  TYPOGRAPHIC SEMANTICS OF WEBPAGES ACCESSIBLE FOR VISUALLY IMPAIRED USERS Mapping Layout and Interaction Objects to an Auditory Interaction Space , 2000 .

[5]  Yoshihiro Kawai,et al.  Stereo correspondence using segment connectivity , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[6]  K. Koshi,et al.  Orientation aids for the blind using ultrasonic signpost system , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[7]  T. Ifukube,et al.  A blind mobility aid modeled after echolocation of bats , 1991, IEEE Transactions on Biomedical Engineering.

[8]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.

[9]  Kazuhide Sugimoto,et al.  R&D of versatile 3D vision system VVV , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[10]  J M Loomis,et al.  Active localization of virtual sounds. , 1990, The Journal of the Acoustical Society of America.