A Mobile Chinese Character Image Recognition Platform

People may have difficulty in reading Chinese books because there always exist some unfamiliar Chinese characters, so it would be valuable if an application can help users including foreigners to learn them. This paper presents a platform based on mobile devices for helping people to recognize the unfamiliar characters at any time or any place. Firstly, we collect various dataset of Chinese characters to build a complete character set, then create the image library according to that set by segmenting. Secondly, the so-called GIST and SIFT features are extracted from the image library to establish feature library. To improve the recognition performance, we filter the SIFT feature points of similar images obtained by GIST feature matching. Finally, compress the storage of GIST and SIFT descriptors to accommodate mobile platform with Similarity Sensitive Coding (SSC) algorithm. At the stage of recognition, the high-dimensional indexing algorithm is applied in finding the top k Chinese characters similar to the image of unfamiliar character by GIST feature, which has the strong versatility and the extension malleability. Then these characters are reordered by SIFT feature matching. The final recognition result is based on the locations of each character in GIST and SIFT matching result respectively. We apply that algorithm in Android platform. It shows great performance in recognition and gives smooth experience to users.

[1]  Pengcheng Gao,et al.  LSH-based large scale chinese calligraphic character recognition , 2013, JCDL '13.

[2]  Pengcheng Gao,et al.  Fast Chinese calligraphic character recognition with large-scale data , 2014, Multimedia Tools and Applications.

[3]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[4]  Trevor Darrell,et al.  Fast pose estimation with parameter-sensitive hashing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  David G. Lowe,et al.  Fast Approximate Nearest Neighbors with Automatic Algorithm Configuration , 2009, VISAPP.

[6]  SchmidCordelia,et al.  A Performance Evaluation of Local Descriptors , 2005 .

[7]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[9]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[10]  Antonio Torralba,et al.  Multidimensional Spectral Hashing , 2012, ECCV.

[11]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[12]  David G. Lowe,et al.  Scalable Nearest Neighbor Algorithms for High Dimensional Data , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.