Offline Text-Independent Writer Identification Based on Writer-Independent Model using Conditional AutoEncoder

In a criminal investigation, a writer identification is frequently performed to find out what kind of writer a certain letter was written. In comparing the similarity between the handwriting of both documents, it is necessary to extract a person's characteristic writing style. Although the text-dependent methods have been studied show high discrimination performance for a writer identification, the situation assumed in the actual appraisal that the same character class does not exist is not supported. In this research, we propose a writer identification method taking into account the actual appraisal situation. We define the handwriting features without dependence on character class as "personal writing style" and construct the AutoEncoder with the condition of character class to extract personal writing style from a single character sample. In the latent space trained by the conditional AutoEncoder, similar personal writing styles are mapped on to neighboring points independent of the character class. At the time of writer identification, the similarity between the handwriting feature of unknown writer and reference writer in the latent space is evaluated. In order to confirm the effectiveness of the proposed method, we conducted a writer identification experiments using ETL-1 Character Database and NIST Special Database 19 2^nd Edition. As a result, it is indicated that it is possible to extract personal writing style, which is an effective feature for writer identification, even under conditions close to the practical situation.

[1]  Flávio Bortolozzi,et al.  An off-line signature verification method based on the questioned document expert's approach and a neural network classifier , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[2]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[3]  Tieniu Tan,et al.  Biometric personal identification based on handwriting , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Manabu Okawa,et al.  Synergy of foreground-background images for feature extraction: Offline signature verification using Fisher vector with fused KAZE features , 2018, Pattern Recognit..

[5]  Kazuhiko Yamamoto,et al.  The Character Generation in Handwriting Feature Extraction Using Variational AutoEncoder , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[6]  Lianwen Jin,et al.  DeepWriterID: An End-to-End Online Text-Independent Writer Identification System , 2015, IEEE Intelligent Systems.

[7]  Sargur N. Srihari,et al.  Writer Identification using a Deep Neural Network , 2014, ICVGIP.

[8]  R. Plamondon,et al.  The relation between pen force and pen-point kinematics in handwriting , 1990, Biological Cybernetics.

[9]  Salman Yussof,et al.  Online Handwritten Signature Verification Using Neural Network Classifier Based on Principal Component Analysis , 2014, TheScientificWorldJournal.

[10]  Luiz Eduardo Soares de Oliveira,et al.  Learning features for offline handwritten signature verification using deep convolutional neural networks , 2017, Pattern Recognit..

[11]  Patrick J. Grother,et al.  NIST Special Database 19 Handprinted Forms and Characters Database , 1995 .

[12]  Sung-Hyuk Cha,et al.  Individuality of handwriting: a validation study , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[13]  Lianwen Jin,et al.  PS-LSTM: Capturing Essential Sequential Online Information with Path Signature and LSTM for Writer Identification , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[14]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[15]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[16]  Andreas K. Maier,et al.  Offline Writer Identification Using Convolutional Neural Network Activation Features , 2015, GCPR.

[17]  I. Guyon,et al.  WANDA: A common ground for forensic handwriting examination and writer identification , 2004 .

[18]  Luiz Eduardo Soares de Oliveira,et al.  Reducing forgeries in writer-independent off-line signature verification through ensemble of classifiers , 2010, Pattern Recognit..

[19]  R. Plamondon,et al.  A multi-level representation paradigm for handwriting stroke generation. , 2006, Human movement science.

[20]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[21]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[22]  Sung-Hyuk Cha,et al.  Individuality of handwriting. , 2002, Journal of forensic sciences.

[23]  Isao Yoshimura,et al.  A Text-Independent Off-Line Writer Identification Method for Japanese and Korean Sentences (Special Issue on Image Processing and Understanding) , 1993 .

[24]  Khaled Elleithy,et al.  Comparison of autoencoder and Principal Component Analysis followed by neural network for e-learning using handwritten recognition , 2017, 2017 IEEE Long Island Systems, Applications and Technology Conference (LISAT).