Automatic number recognition for bus route information aid for the visually-impaired

In this paper, we propose a number recognition method to quickly and accurately get bus route information for the visually-impaired from natural scenes. We take a boosting approach based on Modified Census Transform (MCT) features, applied with success to number detection. Then, a gradient-based feature extraction algorithm is used to recognize the route number from detected samples. Finally, the recognition result is spoken by the Text-To-Speech (TTS) engine via the speaker embedded in tablet PC so that this information can be used when they take a bus without someone's help. In the experiment, we evaluate the performance of number detection and recognition in our dataset. We achieve high accuracy in both detection and recognition to provide reliable information of the bus routes.

[1]  Dongjin Lee,et al.  Handwritten character recognition based on SVMs for a multiplication table game , 2012, 2012 9th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[2]  Kyu-Dae Ban,et al.  Number detection in natural image with boosting classifier , 2012, 2012 9th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[3]  Kyu-Dae Ban,et al.  Tiny and Blurred Face Alignment for Long Distance Face Recognition , 2011 .

[4]  Andreas Ernst,et al.  Face detection with the modified census transform , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Alan L. Yuille,et al.  Detecting and reading text in natural scenes , 2004, CVPR 2004.

[6]  Ho-Sub Yoon,et al.  Sign Recognition with HMM/SVM Hybrid for the Visually-handicapped in Subway Stations , 2012, IJCCI.

[7]  Matti Pietikäinen,et al.  Adaptive document image binarization , 2000, Pattern Recognit..

[8]  J. M. Hans du Buf,et al.  The SmartVision local navigation aid for blind and visually impaired persons , 2011 .

[9]  Jiřı́ Matas,et al.  Real-time scene text localization and recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[11]  Cheng-Lin Liu,et al.  Handwritten Chinese Character Recognition: Effects of Shape Normalization and Feature Extraction , 2006, SACH.

[12]  Jing Zhang,et al.  Text Detection Using Edge Gradient and Graph Spectrum , 2010, 2010 20th International Conference on Pattern Recognition.