Badge3D for Visually Impaired

Conducting an independent life is probably the most important issue for visually impaired people. In this paper, we suggest a contribution to the solution of this problem using wearable computer technology. We present a visual support system that provides acoustic information about the objects in the surrounding environment, obtained by remotely reading barcode tags sticked on significant objects and surrounding elements, such as doors, windows and so on. The user, walking in an indoor environment, is informed in realtime about the location (direction, distance and pose) of the available objects. Barcode tags deployed in the environment can act as reliable stimuli that trigger local navigation behaviours to achieve global navigation objectives. The proposed system is expected to be useful in the real-time interaction with dynamic environments. To illustrate our work, we introduce a proof-of-concept multimodal, sensorbased application and discuss its implementation and the obtained experimental results.

[1]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[2]  Malik Mallem,et al.  Robust camera pose estimation using 2d fiducials tracking for real-time augmented reality systems , 2004, VRCAI '04.

[3]  Nikolaos G. Bourbakis,et al.  An intelligent assistant for navigation of visually impaired people , 2001, Proceedings 2nd Annual IEEE International Symposium on Bioinformatics and Bioengineering (BIBE 2001).

[4]  Andrew Blake,et al.  A framework for spatiotemporal control in the tracking of visual contours , 1993, International Journal of Computer Vision.

[5]  H. Takemura,et al.  Tracking of user position and orientation by stereo measurement of infrared markers and orientation sensing , 2004, Eighth International Symposium on Wearable Computers.

[6]  Jun Rekimoto,et al.  CyberCode: designing augmented reality environments with visual tags , 2000, DARE '00.

[7]  Kazushige Magatani,et al.  Development of the navigation system for the visually impaired , 2003, IEEE EMBS Asian-Pacific Conference on Biomedical Engineering, 2003..

[8]  Ivan Kopeček,et al.  Navigation and Information System for Visually Impaired People , 1997 .

[9]  Iwan Ulrich,et al.  The GuideCane-applying mobile robot technologies to assist the visually impaired , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[10]  J. Takeno,et al.  Research and development of a hand-held vision system for the visually impaired , 1999, 8th IEEE International Workshop on Robot and Human Interaction. RO-MAN '99 (Cat. No.99TH8483).

[11]  Jun-Wei Hsieh,et al.  Camera-based bar code recognition system using neural net , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[12]  Milan Sonka,et al.  Image pre-processing , 1993 .

[13]  Andrew W. Fitzgibbon,et al.  Reliable Automatic Calibration of a Marker-Based Position Tracking System , 2005, 2005 Seventh IEEE Workshops on Applications of Computer Vision (WACV/MOTION'05) - Volume 1.

[14]  Yoshihiro Kawai,et al.  A support system for visually impaired persons to understand three-dimensional visual information using acoustic interface , 2002, Object recognition supported by user interaction for service robots.

[15]  Hidekata Hontani,et al.  Automatic visual searching and reading of barcodes in 3-D scene , 2001, IVEC2001. Proceedings of the IEEE International Vehicle Electronics Conference 2001. IVEC 2001 (Cat. No.01EX522).

[16]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[17]  Shraga Shoval,et al.  Computerized obstacle avoidance systems for the blind and visually impaired , 2001 .

[18]  Hideo Makino,et al.  3-D object information system for the visually impaired using an infrared reflective bar code , 1994, Proceedings of 16th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Thomas S. Huang,et al.  Image processing , 1971 .

[20]  Dieter Schmalstieg,et al.  Structured visual markers for indoor pathfinding , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[21]  J. Takeno,et al.  Practicability verification of a visual aid system for the visually impaired , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[22]  W.D. Jones.  Sight for sore ears [visual aids for the blind] , 2004, IEEE Spectrum.

[23]  K. Magatani,et al.  Development of the navigation system for visually impaired , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[24]  Milan Sonka,et al.  Image processing analysis and machine vision [2nd ed.] , 1999 .

[25]  Luigi di Stefano,et al.  Real-Time Stereo within the VIDET Project , 2002, Real Time Imaging.

[26]  R. Jirawimut,et al.  Visual odometer for pedestrian navigation , 2002, IMTC/2002. Proceedings of the 19th IEEE Instrumentation and Measurement Technology Conference (IEEE Cat. No.00CH37276).

[27]  Abdelsalam Helal,et al.  Drishti: an integrated indoor/outdoor blind navigation system and service , 2004, Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. Proceedings of the.

[28]  Penny Probert Smith,et al.  A stereo vision-based aid for the visually impaired , 1998, Image Vis. Comput..