PS-LSTM: Capturing Essential Sequential Online Information with Path Signature and LSTM for Writer Identification

Writer identification plays a significant role in several applications including forensic trace evidence identification, mobile bank transaction authentication, and handwritten character/text recognition. However, performing writer identification requires a considerable amount of experimental work and labor, as well as professional skills. In this paper, we propose a novel path-signature long short-term memory (PS-LSTM) recurrent neural network for writer identification that contributes as follows: 1) A mathematical feature set, path signature, is successfully applied to writer identification to characterize the essential geometric and analytic properties of pen-tip trajectory, which help distinguish between the diverse writing styles of different people, especially in confusing situations. 2) Different iterated integrals of path signature are investigated to model the local curvature nature of the pen-tip trajectory for writer identification. 3) Our study is the first to demonstrate the significance of integrating path signature with long short-term memory for writer identification. On Database CASIA-OLHWDN1.0, the proposed PS-LSTM writer identification achieves significantly superior results and outperforms previous works.

[1]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Tao Mei,et al.  Jointly Modeling Embedding and Translation to Bridge Video and Language , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Marcus Liwicki,et al.  A writer identification system for on-line whiteboard data , 2008, Pattern Recognit..

[5]  Endra,et al.  Online Signature Verification on Mobile Devices , 2015 .

[6]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[7]  Lambert Schomaker,et al.  Text-Independent Writer Identification and Verification Using Textural and Allographic Features , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Terry Lyons,et al.  System Control and Rough Paths , 2003 .

[9]  H. N. Prakash,et al.  Online Signature Verification and Recognition: An Approach Based on Symbolic Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Wen-Yen Wu,et al.  Corner detection using bending value , 1995, Pattern Recognit. Lett..

[11]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[12]  Marcus Liwicki,et al.  A novel approach to on-line handwriting recognition based on bidirectional long short-term memory networks , 2007 .

[13]  Razvan Pascanu,et al.  How to Construct Deep Recurrent Neural Networks , 2013, ICLR.

[14]  Terry Lyons,et al.  Uniqueness for the signature of a path of bounded variation and the reduced path group , 2005, math/0507536.

[15]  Lianwen Jin,et al.  Fully convolutional recurrent network for handwritten Chinese text recognition , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[16]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[17]  Kuo-Tsai Chen INTEGRATION OF PATHS—A FAITHFUL REPRE- SENTATION OF PATHS BY NONCOMMUTATIVE FORMAL POWER SERIES , 1958 .

[18]  Yoshua Bengio,et al.  End-to-End Online Writer Identification With Recurrent Neural Network , 2017, IEEE Transactions on Human-Machine Systems.

[19]  Lianwen Jin,et al.  Chinese character-level writer identification using path signature feature, DropStroke and deep CNN , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[20]  Benjamin Graham,et al.  Sparse arrays of signatures for online character recognition , 2013, ArXiv.

[21]  Terry Lyons Rough paths, Signatures and the modelling of functions on streams , 2014, 1405.4537.

[22]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Lianwen Jin,et al.  DropSample: A New Training Method to Enhance Deep Convolutional Neural Networks for Large-Scale Unconstrained Handwritten Chinese Character Recognition , 2015, Pattern Recognit..

[24]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[25]  Lianwen Jin,et al.  Improved deep convolutional neural network for online handwritten Chinese character recognition using domain-specific knowledge , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[26]  Fei Yin,et al.  CASIA Online and Offline Chinese Handwriting Databases , 2011, 2011 International Conference on Document Analysis and Recognition.

[27]  Lianwen Jin,et al.  DeepWriterID: An End-to-End Online Text-Independent Writer Identification System , 2015, IEEE Intelligent Systems.

[28]  Trevor Darrell,et al.  Sequence to Sequence -- Video to Text , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).