Colorplate: Virtual Leading Blocks for the Deaf-Blind: A Real-Time Way-Finder by Verbal-Nonverbal Hybrid Interface and High-Density RFID Tag Space

In this paper, we discuss application possibilities of augmented reality technologies in the field of mobility support for the deaf blind. We propose the navigation system called virtual leading blocks for the deaf-blind, which consists of a wearable interface for Finger-Braille, one of the commonly used communication methods among deaf-blind people in Japan, and a ubiquitous environment for barrier-free application, which consists of floor-embedded active radio-frequency identification (RFID) tags. The wearable Finger-Braille interface using two Linux-based wristwatch computers has been developed as a hybrid interface of verbal and nonverbal communication in order to inform users of their direction and position through the tactile sensation. We propose the metaphor of "watermelon splitting" for navigation by this system and verify the feasibility of the proposed system through experiments.

[1]  Anatole Lécuyer,et al.  HOMERE: a multimodal system for visually impaired people to explore virtual environments , 2003, IEEE Virtual Reality, 2003. Proceedings..

[2]  Ken Tamagawa,et al.  Linux Watch: Hardware Platform for Wearable Computing Research , 2001, IEEE Pacific Rim Conference on Multimedia.

[3]  Gaetano Borriello,et al.  Location Systems for Ubiquitous Computing , 2001, Computer.

[4]  David A. Ross,et al.  Wearable interfaces for orientation and wayfinding , 2000, Assets '00.

[5]  Yoshimichi Yonezawa,et al.  Basic study of optimum stimulus mode for finger Braille display , 2000 .

[6]  Stefano Mattoccia,et al.  Perception of depth information by means of a wire-actuated haptic interface , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  Gaetano Borriello,et al.  SpotON: An Indoor 3D Location Sensing Technology Based on RF Signal Strength , 2000 .

[8]  Alex Pentland,et al.  A wearable haptic navigation guidance system , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[9]  Iwan Ulrich,et al.  The GuideCane-a computerized travel aid for the active guidance of blind pedestrians , 1997, Proceedings of International Conference on Robotics and Automation.

[10]  Thomas G. Zimmerman,et al.  : Near-field , 2022 .

[11]  Roberta L. Klatzky,et al.  Personal guidance system for the visually impaired , 1994, ASSETS.