Chinese calligraphic style representation for recognition

Chinese calligraphy draws a lot of attention for its beauty and elegance. The various styles of calligraphic characters make calligraphy even more charming. But it is not always easy to recognize the calligraphic style correctly, especially for beginners. In this paper, an automatic character styles representation for recognition method is proposed. Three kinds of features are extracted to represent the calligraphic characters. Two of them are typical hand-designed features: the global feature, GIST and the local feature, scale invariant feature transform. The left one is deep feature which is extracted by a deep convolutional neural network (CNN). The state-of-the-art classifier modified quadratic discriminant function was employed to perform recognition. We evaluated our method on two calligraphic character datasets, the unconstraint real-world calligraphic character dataset (CCD) and SCL (the standard calligraphic character library). And we also compare MQDF with other two classifiers, support vector machine and neural network, to perform recognition. In our experiments, all three kinds of feature are evaluated with all three classifiers, respectively, finding that deep feature is the best feature for calligraphic style recognition. We also fine-tune the deep CNN (alex-net) in Krizhevsky et al. (Advances in Neural Information Processing Systems, pp. 1097–1105, 2012) to perform calligraphic style recognition. It turns out our method achieves about equal accuracy comparing with the fine-tuned alex-net but with much less training time. Furthermore, the algorithm style discrimination evaluation is developed to evaluate the discriminative style quantitatively.

[1]  Lianwen Jin,et al.  Sparse Discriminative Information Preservation for Chinese character font categorization , 2014, Neurocomputing.

[2]  Pengcheng Gao,et al.  LSH-based large scale chinese calligraphic character recognition , 2013, JCDL '13.

[3]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[4]  Yunhe Pan,et al.  Automatic generation of artistic chinese calligraphy , 2004, IEEE Intelligent Systems.

[5]  Tieniu Tan,et al.  Font Recognition Based on Global Texture Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Xuelong Li,et al.  Principal Component 2-D Long Short-Term Memory for Font Recognition on Single Chinese Characters , 2016, IEEE Transactions on Cybernetics.

[7]  Yueting Zhuang,et al.  Latent Style Model: Discovering writing styles for calligraphy works , 2009, J. Vis. Commun. Image Represent..

[8]  Pengcheng Gao,et al.  Fast Chinese calligraphic character recognition with large-scale data , 2014, Multimedia Tools and Applications.

[9]  Yueting Zhuang,et al.  Skeleton-Based Recognition of Chinese Calligraphic Character Image , 2008, PCM.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Kai Yu,et al.  Chinese calligraphy specific style rendering system , 2010, JCDL '10.

[12]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[13]  Xia Yang,et al.  Fast Image-based Chinese Calligraphic Character Retrieval on Large Scale Data , 2014, IEEE/ACM Joint Conference on Digital Libraries.

[14]  Pengcheng Gao,et al.  Ontology‐based model for Chinese Calligraphy Synthesis , 2013, Comput. Graph. Forum.

[15]  Li Chen,et al.  Character Independent Font Recognition on a Single Chinese Character , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[17]  Yueting Zhuang,et al.  Discovering calligraphy style relationships by Supervised Learning Weighted Random Walk Model , 2009, Multimedia Systems.

[18]  Hsi-Jian Lee,et al.  Dual-binarization and anisotropic diffusion of Chinese characters in calligraphy documents , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[19]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[20]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[22]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[23]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[24]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[25]  Jiwen Lu,et al.  Deep hashing for compact binary codes learning , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[27]  Peng Liu,et al.  Calligraphy Beautification Method for Chinese Handwritings , 2012, 2012 Fourth International Conference on Digital Home.

[28]  Yueting Zhuang,et al.  Web based Chinese Calligraphy Learning with 3-D Visualization Method , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[29]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[30]  Fumitaka Kimura,et al.  Modified Quadratic Discriminant Functions and the Application to Chinese Character Recognition , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[32]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[33]  Yueting Zhuang,et al.  Retrieval of Chinese Calligraphic Character Image , 2004, PCM.

[34]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.