Handwriting posture prediction based on unsupervised model

Abstract Writing is an important basic skill for humans. To acquire such a skill, pupils often have to practice writing for several hours each day. However, different pupils usually possess distinct writing postures. Bad postures not only affect the speed and quality of writing, but also severely harm the healthy development of pupils’ spine and eyesight. Therefore, it is of key importance to identify or predict pupils’ writing postures and accordingly correct bad ones. In this paper, we formulate the problem of handwriting posture prediction for the first time. Further, we propose a neural network constructed with small convolution kernels to extract features from handwriting, and incorporate unsupervised learning and handwriting data analysis to predict writing postures. Extensive experiments reveal that our approach achieves an accuracy rate of 93.3%, which is significantly higher than the 76.67% accuracy of human experts.

[1]  Cécile Barat,et al.  String representations and distances in deep Convolutional Neural Networks for image classification , 2016, Pattern Recognit..

[2]  Changshui Zhang,et al.  End-to-end Chinese text recognition , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[3]  Ricardo da Silva Torres,et al.  Hierarchical Clustering-Based Graphs for Large Scale Approximate Nearest Neighbor Search , 2019, Pattern Recognit..

[4]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[5]  Hau-San Wong,et al.  Unsupervised Multi-task Learning with Hierarchical Data Structure , 2019, Pattern Recognit..

[6]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Qing Han,et al.  A Scene Recognition and Semantic Analysis Approach to Unhealthy Sitting Posture Detection during Screen-Reading , 2018, Sensors.

[8]  Yu Ming,et al.  SVM parameters optimization based on artificial bee colony algorithm and its application in handwriting verification , 2011, 2011 International Conference on Electrical and Control Engineering.

[9]  Arun Ross,et al.  On automated source selection for transfer learning in convolutional neural networks , 2018, Pattern Recognit..

[10]  Raymond W. Ptucha,et al.  Intelligent character recognition using fully convolutional neural networks , 2019, Pattern Recognit..

[11]  Rongrong Ji,et al.  Bio-Inspired Deep Attribute Learning Towards Facial Aesthetic Prediction , 2018, IEEE Transactions on Affective Computing.

[12]  Kai Chen,et al.  Compressing CNN-DBLSTM models for OCR with teacher-student learning and Tucker decomposition , 2019, Pattern Recognit..

[13]  Rongrong Ji,et al.  Learning-Based Shadow Recognition and Removal From Monochromatic Natural Images , 2017, IEEE Transactions on Image Processing.

[14]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[15]  Yan Zhang,et al.  Semi-supervised local multi-manifold Isomap by linear embedding for feature extraction , 2018, Pattern Recognit..

[16]  Marco Mora,et al.  Off-line writer verification based on simple graphemes , 2018, Pattern Recognit..

[17]  Marcus Liwicki,et al.  The Impact of Visual Similarities of Arabic-Like Scripts Regarding Learning in an OCR System , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[18]  Xiaogang Wang,et al.  Learning Feature Pyramids for Human Pose Estimation , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[19]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[20]  Anastasios Tefas,et al.  Discriminative clustering using regularized subspace learning , 2019, Pattern Recognit..

[21]  Yunde Jia,et al.  Deep convolutional network with locality and sparsity constraints for texture classification , 2019, Pattern Recognit..

[22]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[23]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[24]  Seunghak Lee,et al.  Landmark MDS ensemble , 2009, Pattern Recognit..

[25]  Xiaodong Yu,et al.  Attribute-Based Transfer Learning for Object Categorization with Zero/One Training Example , 2010, ECCV.

[26]  Kaizhu Huang,et al.  m-SNE: Multiview Stochastic Neighbor Embedding , 2011, IEEE Trans. Syst. Man Cybern. Part B.

[27]  Fang Hao,et al.  D-STC: Deep learning with spatio-temporal constraints for train drivers detection from videos , 2019, Pattern Recognit. Lett..

[28]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Lambert Schomaker,et al.  Deep Adaptive Learning for Writer Identification based on Single Handwritten Word Images , 2018, Pattern Recognit..

[30]  Daniel Carlos Guimarães Pedronette,et al.  Unsupervised manifold learning through reciprocal kNN graph and Connected Components for image retrieval tasks , 2018, Pattern Recognit..

[31]  Xiaogang Wang,et al.  Structured Feature Learning for Pose Estimation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  James F. Peters,et al.  Multi-manifold LLE learning in pattern recognition , 2015, Pattern Recognit..