Recurrent Adaptation Networks for Online Signature Verification

Online signature verification remains a challenging task owing to large intra-individual variability. To tackle this problem, in this paper, we propose to use recurrent neural networks (RNN) for representation learning in the dynamic time warping framework. Metric-based loss functions are designed explicitly to minimize intra-individual variability and enhance inter-individual variability and to guide the RNN in learning discriminative representations for online signatures. An RNN variant—gated auto regressive units—is proposed and shows a better generalization performance in our framework. Furthermore, we interpret the online signature verification problem as a meta-learning problem: one client is considered as one task, therefore, different clients compose the task space. Based on this formulation, we design an end-to-end trainable meta-layer that learns to adapt to different clients, allowing fast adaptation to new clients in the test stage. In addition, a new descriptor—the length-normalized path signature—is proposed to describe online signatures. Our proposed system achieves a state-of-the-art performance on three benchmark datasets, namely, MCYT-100, Mobisig, and e-BioSign.

[1]  Gang Hua,et al.  Order-Preserving Wasserstein Distance for Sequence Matching , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  D. S. Guru,et al.  Interval valued symbolic representation of writer dependent features for online signature verification , 2017, Expert Syst. Appl..

[3]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Lianwen Jin,et al.  DeepWriterID: An End-to-End Online Text-Independent Writer Identification System , 2015, IEEE Intelligent Systems.

[5]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[6]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[7]  Giuseppe Pirlo,et al.  Multidomain Verification of Dynamic Signatures Using Local Stability Analysis , 2015, IEEE Transactions on Human-Machine Systems.

[8]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[9]  Andrey Kormilitzin,et al.  A Primer on the Signature Method in Machine Learning , 2016, ArXiv.

[10]  Mei Wang,et al.  Deep Face Recognition: A Survey , 2018, Neurocomputing.

[11]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Réjean Plamondon,et al.  Synthetic on-line signature generation. Part I: Methodology and algorithms , 2012, Pattern Recognit..

[13]  Julian Fiérrez,et al.  Biometric Signature Verification Using Recurrent Neural Networks , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[14]  Lianwen Jin,et al.  Online Signature Verification Using Recurrent Neural Network and Length-Normalized Path Signature Descriptor , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[15]  Suresh Sundaram,et al.  An enhanced contextual DTW based system for online signature verification using Vector Quantization , 2016, Pattern Recognit. Lett..

[16]  Julian Fiérrez,et al.  Synthetic on-line signature generation. Part II: Experimental validation , 2012, Pattern Recognit..

[17]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[18]  Juan Carlos Gómez,et al.  Legendre polynomials based feature extraction for online signature verification. Consistency analysis of feature combinations , 2014, Pattern Recognit..

[19]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[20]  Réjean Plamondon,et al.  Dynamic Signature Verification System Based on One Real Signature , 2018, IEEE Transactions on Cybernetics.

[21]  Robert Sabourin,et al.  Offline handwritten signature verification — Literature review , 2017, 2017 Seventh International Conference on Image Processing Theory, Tools and Applications (IPTA).

[22]  Anirban Mukherjee,et al.  Stroke Point Warping-Based Reference Selection and Verification of Online Signature , 2018, IEEE Transactions on Instrumentation and Measurement.

[23]  Benjamin Graham,et al.  Sparse arrays of signatures for online character recognition , 2013, ArXiv.

[24]  Rafal Doroz,et al.  Dynamic signature verification method based on association of features with similarity measures , 2016, Neurocomputing.

[25]  Bernadette Dorizzi,et al.  On Using the Viterbi Path Along With HMM Likelihood Information for Online Signature Verification , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[26]  Endra,et al.  Online Signature Verification on Mobile Devices , 2015 .

[27]  Margit Antal,et al.  Online Signature Verification on MOBISIG Finger-Drawn Signature Corpus , 2018, Mob. Inf. Syst..

[28]  Wenxiong Kang,et al.  Information Divergence-Based Matching Strategy for Online Signature Verification , 2018, IEEE Transactions on Information Forensics and Security.

[29]  Julian Fiérrez,et al.  HMM-based on-line signature verification: Feature extraction and signature modeling , 2007, Pattern Recognit. Lett..

[30]  Berrin A. Yanikoglu,et al.  Identity authentication using improved online signature verification method , 2005, Pattern Recognit. Lett..

[31]  Yoshua Bengio,et al.  Drawing and Recognizing Chinese Characters with Recurrent Neural Network , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yoshua Bengio,et al.  Improving Speech Recognition by Revising Gated Recurrent Units , 2017, INTERSPEECH.

[33]  Lianwen Jin,et al.  DropSample: A New Training Method to Enhance Deep Convolutional Neural Networks for Large-Scale Unconstrained Handwritten Chinese Character Recognition , 2015, Pattern Recognit..

[34]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[35]  Miguel Angel Ferrer-Ballester,et al.  On-line signature recognition through the combination of real dynamic data and synthetically generated static data , 2015, Pattern Recognit..

[36]  Lihua Yang,et al.  Online Signature Verification Based on DCT and Sparse Representation , 2015, IEEE Transactions on Cybernetics.

[37]  Joscha Diehl Rotation invariants of two dimensional curves based on iterated integrals , 2013, ArXiv.

[38]  Robert Sabourin,et al.  Fixed-sized representation learning from offline handwritten signatures of different sizes , 2018, International Journal on Document Analysis and Recognition (IJDAR).

[39]  Terry Lyons,et al.  Uniqueness for the signature of a path of bounded variation and the reduced path group , 2005, math/0507536.

[40]  Lianwen Jin,et al.  Learning Spatial-Semantic Context with Fully Convolutional Recurrent Network for Online Handwritten Chinese Text Recognition , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Suresh Sundaram,et al.  A Novel Online Signature Verification System Based on GMM Features in a DTW Framework , 2017, IEEE Transactions on Information Forensics and Security.

[42]  Hossein Zeinali,et al.  Online signature verification using i-vector representation , 2017, IET Biom..

[43]  Xiaoyu Song,et al.  Signature alignment based on GMM for on-line signature verification , 2017, Pattern Recognit..

[44]  Marcos Martínez Díaz,et al.  Dynamic signature verification for portable devices , 2008 .

[45]  Suresh Sundaram,et al.  On the Exploration of Information From the DTW Cost Matrix for Online Signature Verification , 2018, IEEE Transactions on Cybernetics.

[46]  Yu Zhang,et al.  Simple Recurrent Units for Highly Parallelizable Recurrence , 2017, EMNLP.

[47]  Luiz Eduardo Soares de Oliveira,et al.  Learning features for offline handwritten signature verification using deep convolutional neural networks , 2017, Pattern Recognit..

[48]  Julian Fierrez,et al.  Exploring Recurrent Neural Networks for On-Line Handwritten Signature Biometrics , 2018, IEEE Access.

[49]  Julian Fierrez,et al.  Benchmarking desktop and mobile handwriting across COTS devices: The e-BioSign biometric database , 2017, PloS one.

[50]  Xiaoyu Song,et al.  Online Signature Verification Based on Stable Features Extracted Dynamically , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[51]  Réjean Plamondon,et al.  Handwritten Signature Verification: New Advancements and Open Issues , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[52]  H. N. Prakash,et al.  Online Signature Verification and Recognition: An Approach Based on Symbolic Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Lianwen Jin,et al.  Toward high-performance online HCCR: A CNN approach with DropDistortion, path signature and spatial stochastic max-pooling , 2017, Pattern Recognit. Lett..

[54]  Bagher BabaAli,et al.  Usage of autoencoders and Siamese networks for online handwritten signature verification , 2017, Neural Computing and Applications.

[55]  Joshua Achiam,et al.  On First-Order Meta-Learning Algorithms , 2018, ArXiv.

[56]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[57]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[58]  Berrin A. Yanikoglu,et al.  Online Signature Verification Using Fourier Descriptors , 2009, EURASIP J. Adv. Signal Process..