A light-weight text image processing method for handheld embedded cameras

In the past few years we have witnessed the migration of cheap imaging devices into portable and mobile computing appliances such as PDAs and mobile phones. As these devices become ever more powerful in terms of processor speed and memory, new exciting applications and uses are being developed. A particularly useful one is the casual capture of text images for faxing, note taking, OCR, etcetera. This paper describes the image processing pipeline used to enhance images of text captured by a hand-held low-resolution camera, and a fast text extraction method. The main advantages of the approach are its inherent lightweight structure, speed and relative robustness under poor lighting and focus conditions. The computational efficiency (and a careful implementation) of the approach has allowed its deployment in an interactive-time text capture and foreign-text translation demo on a PDA with a VGA camera attachment.

[1]  Ismail Haritaoglu.  Scene text extraction and translation for handheld devices , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  R. Keys.  Cubic convolution interpolation for digital image processing , 1981 .

[3]  George Wolberg,et al.  Digital image warping , 1990 .

[4]  Maurizio Pilu,et al.  Extraction of illusory linear clues in perspectively skewed documents , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  E. Land.  The retinex theory of color vision. , 1977, Scientific American.

[6]  E H Land,et al.  An alternative technique for the computation of the designator in the retinex theory of color vision. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Majid Mirmehdi,et al.  Estimating the Orientation and Recovery of Text Planes in a Single Image , 2001, BMVC.

[8]  Jr. James E. Adams,et al.  Design of practical color filter array interpolation algorithms for digital cameras , 1997, Electronic Imaging.