Text-tracking wearable camera system for visually-impaired people

Disability of visual text reading has a huge impact on the quality of life for visually disabled people. One of the most anticipated devices is a wearable camera capable of finding text regions in natural scenes and translating the text into another representation such as sound or braille. In order to develop such a device, text tracking in video sequences is required as well as text detection. We need to group homogeneous text regions to avoid multiple and redundant speech syntheses or braille conversions. We have developed a prototype system equipped with a head-mounted video camera. Text regions are extracted from the video frames using a revised DCT feature. Particle filtering is employed for fast and robust text tracking. We have tested the performance of our system using 1,000 video frames of a hall way with eight signboards. The number of text candidate images is reduced to 0.98%.

[1]  Carlos Merino.  A Framework Towards Realtime Detection and Tracking of Text , 2007 .

[2]  François Michaud,et al.  Autonomous Mobile Robot That Can Read , 2004, EURASIP J. Adv. Signal Process..

[3]  Hideaki Goto.  Redefining the DCT-based feature for scene text detection , 2008, International Journal of Document Analysis and Recognition (IJDAR).

[4]  François Michaud,et al.  Textual message read by a mobile robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[5]  J. Samarabandu,et al.  An edge-based text region extraction algorithm for indoor mobile robot navigation , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[6]  Makoto Tanaka,et al.  Autonomous Text Capturing Robot Using Improved DCT Feature and Text Tracking , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[7]  Kazuhiko Yamamoto,et al.  Development of a guide dog system for the blind people with character recognition ability , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Hiroaki Kobayashi,et al.  An Efficient Text Capture Method for Moving Robots Using DCT Feature and Text Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).