Mobile Camera Based Text Detection and Translation

Inspired by the well-know iPhone app “Word Lens”, we developed an Android-platform based text translation application that is able to recognize the text captured by a mobile phone camera, translate the text, and display the translation result back onto the screen of the mobile phone. Our text extraction and recognition algorithm has a correct-recognition rate that is greater than 85% on character level. In this report, we demonstrate the system flow, the text detection algorithm and detailed experiment result.

[1]  David S. Doermann,et al.  Automatic text detection and tracking in digital video , 2000, IEEE Trans. Image Process..

[2]  Bernard Gosselin,et al.  Color text extraction with selective metric-based clustering , 2007, Comput. Vis. Image Underst..