A Low Complexity Sign Detection and Text Localization Method for Mobile Applications

We propose a low complexity method for sign detection and text localization in natural images. This method is designed for mobile applications (e.g., unmanned or handheld devices) in which computational and energy resources are limited. No prior assumption is made regarding the text size, font, language, or character set. However, the text is assumed to be located on a homogeneous background using a contrasting color. We have deployed our method on a Nokia N800 cellular phone as part of a system for automatic detection and translation of outdoor signs. This handheld device is equipped with a 0.3-megapixel camera capable of acquiring images of outdoor signs that typically contain enough details for the sign to be readable by a human viewer. Our experiments show that the text of these images can be accurately localized within the device in a fraction of a second.

[1]  Qian Huang,et al.  Character extraction of license plates from video , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Anil K. Jain,et al.  Automatic text location in images and video frames , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[3]  Nevenka Dimitrova,et al.  Text detection for video analysis , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[4]  Wolfgang Effelsberg,et al.  Automatic text segmentation and text recognition for video indexing , 2000, Multimedia Systems.

[5]  JungHyun Han,et al.  Support vector machines for text location in news video images , 2000, 2000 TENCON Proceedings. Intelligent Systems and Technologies for the New Millennium (Cat. No.00CH37119).

[6]  Chew Lim Tan,et al.  Text extraction from gray scale document images using edge information , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[7]  Alex Waibel,et al.  An automatic sign recognition and translation system , 2001, PUI '01.

[8]  Jiang Gao,et al.  An adaptive algorithm for text detection from natural scenes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[9]  Jiang Wu,et al.  Automatic text detection in complex color image , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[10]  Beom-Joon Cho,et al.  Locating characters in scene images using frequency features , 2002, Object recognition supported by user interaction for service robots.

[11]  Jin Hyung Kim,et al.  Texture-Based Approach for Text Detection in Images Using Support Vector Machines and Continuously Adaptive Mean Shift Algorithm , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ralph Ewerth,et al.  A robust algorithm for text detection in images , 2003, 3rd International Symposium on Image and Signal Processing and Analysis, 2003. ISPA 2003. Proceedings of the.

[13]  Alan L. Yuille,et al.  Detecting and reading text in natural scenes , 2004, CVPR 2004.

[14]  Xilin Chen,et al.  Automatic detection and recognition of signs from natural scenes , 2004, IEEE Transactions on Image Processing.

[15]  Lambert Schomaker,et al.  Text detection from natural scene images: towards a system for visually impaired persons , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[16]  Santa Barbara,et al.  Embedded-Text Detection and Its Application to Anti-Spam Filtering , 2005 .

[17]  Xilin Chen,et al.  Detection of text on road signs from video , 2005, IEEE Trans. Intell. Transp. Syst..

[18]  Sang-Cheol Park,et al.  Text Locating from Natural Scene Images Using Image Intensitie , 2005, ICDAR.

[19]  Ching-Tung Wu.  Embedded-Text Detection and Its Application to Anti-Spam Filtering , 2005 .

[20]  S.M. Lucas,et al.  ICDAR 2005 text locating competition results , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[21]  Satoshi Goto,et al.  A robust algorithm for text detection in color images , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[22]  W. Jirattitichareon,et al.  Automatic Detection and Segmentation of Text in Low Quality Thai Sign Images , 2006, APCCAS 2006 - 2006 IEEE Asia Pacific Conference on Circuits and Systems.

[23]  P. Dubey.  Edge Based Text Detection for Multi-purpose Application , 2006, 2006 8th international Conference on Signal Processing.

[24]  Edward J. Delp,et al.  Automatic text area segmentation in natural images , 2008, 2008 15th IEEE International Conference on Image Processing.

[25]  Palaiahnakote Shivakumara,et al.  An Efficient Edge Based Technique for Text Detection in Video Frames , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[26]  Edward J. Delp,et al.  The Rosetta phone: a hand-held device for automatic translation of signs in natural images , 2008, Electronic Imaging.

[27]  Jia Yu,et al.  Apply SOM to Video Artificial Text Area Detection , 2009, 2009 Fourth International Conference on Internet Computing for Science and Engineering.

[28]  Huadong Ma,et al.  Automatic Detection and Localization of Natural Scene Text in Video , 2010, 2010 20th International Conference on Pattern Recognition.

[29]  Charles A. Bouman,et al.  Multiscale segmentation for MRC document compression using a Markov random field model , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[30]  Chew Lim Tan,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence, Manuscript Id a Laplacian Approach to Multi-oriented Text Detection in Video , 2022 .