A Multifunctional Reading Assistant for the Visually Impaired

In the growing market of camera phones, new applications for the visually impaired are nowadays being developed thanks to the increasing capabilities of these equipments. The need to access to text is of primary importance for those people in a society driven by information. To meet this need, our project objective was to develop a multifunctional reading assistant for blind community. The main functionality is the recognition of text in mobile situations but the system can also deal with several specific recognition requests such as banknotes or objects through labels. In this paper, the major challenge is to fully meet user requirements taking into account their disability and some limitations of hardware such as poor resolution, blur, and uneven lighting. For these applications, it is necessary to take a satisfactory picture, which may be challenging for some users. Hence, this point has also been considered by proposing a training tutorial based on image processing methods as well. Developed in a user-centered design, text reading applications are described along with detailed results performed on databases mostly acquired by visually impaired users.

[1]  Benoit M. Macq,et al.  A Rarity-Based Visual Attention Map - Application to Texture Description , 2006, 2006 International Conference on Image Processing.

[2]  Edward M. Riseman,et al.  TextFinder: An Automatic System to Detect and Recognize Text In Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Shu-Yuan Chen,et al.  Adaptive page segmentation for color technical journals' cover images , 1998, Image Vis. Comput..

[4]  C. Garcia,et al.  Text detection and segmentation in complex color images , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[5]  Céline Mancas-Thillou,et al.  A Weighted Finite-State Framework for Correcting Errors in Natural Scene OCR , 2007 .

[6]  Richard Gran,et al.  On the Convergence of Random Search Algorithms In Continuous Time with Applications to Adaptive Control , 1970, IEEE Trans. Syst. Man Cybern..

[7]  Sorin Draghici,et al.  A Neural Network Based Artificial Vision System for Licence Plate Recognition , 1997, Int. J. Neural Syst..

[8]  Céline Mancas-Thillou,et al.  Embedded reading device for blind people: a user-centered design , 2004, 33rd Applied Imagery Pattern Recognition Workshop (AIPR'04).

[9]  Datong Chen,et al.  Text detection and recognition in images and video sequences , 2003 .

[10]  Anil K. Jain,et al.  Text segmentation using gabor filters for automatic document processing , 1992, Machine Vision and Applications.

[11]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[12]  Rainer Lienhart,et al.  Localizing and segmenting text in images and videos , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[14]  Hang Joon Kim,et al.  Automatic recognition of a car license plate using color image processing , 1994, Proceedings of 1st International Conference on Image Processing.

[15]  Xilin Chen,et al.  A PDA-based sign translator , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[16]  William E. Higgins,et al.  Texture Segmentation using 2-D Gabor Elementary Functions , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Anil K. Jain,et al.  Automatic text location in images and video frames , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[18]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[19]  Bernard Gosselin,et al.  Natural Scene Text Understanding , 2007 .

[20]  Matti Pietikäinen,et al.  EXTRACTION FROM GREY SCALE PAGE IMAGES BY SIMPLE EDGE DETECTORS , 2001 .

[21]  Anil K. Jain,et al.  Locating text in complex color images , 1995, Pattern Recognit..