A Cross-Modal Electronic Travel Aid Device

This paper describes the design of an Electronic Travel Aid device, that will enable blind individuals to "see the world with their ears." A wearable prototype will be assembled using low-cost hardware: earphones, sunglasses fitted with two CMOS micro cameras, and a palmtop computer. Currently, the system is able to detect the light spot produced by a laser pointer, compute its angular position and depth, and generate a correspondent sound providing the auditory cues for the perception of the position and distance of the pointed surface. In this way the blind person can use a common pointer as a replacement of the cane.

[1]  Richard O. Duda,et al.  A structural model for binaural sound synthesis , 1998, IEEE Trans. Speech Audio Process..

[2]  M. Kubovy,et al.  Auditory and visual objects , 2001, Cognition.

[3]  Leslie Kay,et al.  Air Sonars with Acoustical Display of Spatial Information , 1980 .

[4]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[5]  Heinrich Kuttruff,et al.  Room acoustics , 1973 .

[6]  Julius O. Smith,et al.  Physical Modeling with the 2-D Digital Waveguide Mesh , 1993, ICMC.

[7]  Raymond M. Fish An Audio Display for the Blind , 1976, IEEE Transactions on Biomedical Engineering.

[8]  J. Blauert Spatial Hearing: The Psychophysics of Human Sound Localization , 1983 .

[9]  J. Strikwerda Finite Difference Schemes and Partial Differential Equations , 1989 .

[10]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[11]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[12]  Ingemar J. Cox,et al.  A Maximum Likelihood Stereo Algorithm , 1996, Comput. Vis. Image Underst..

[13]  Y. Bar-Shalom Tracking and data association , 1988 .

[14]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[15]  Davide Rocchesso,et al.  USING THE WAVEGUIDE MESH IN MODELLING 3D RESONATORS , 2000 .

[16]  Julius O. Smith,et al.  A Simplified Approach to Modeling Dispersion Caused by Stiffness in Strings and Plates , 1994, ICMC.