Prewarping Siamese Network: Learning Local Representations for Online Signature Verification

We propose a neural network-based framework for learning local representations of multivariate time series, and demonstrate its effectiveness for online signature verification. In contrast to related works that optimize a global distance objective, we incorporate a Siamese network into dynamic time warping (DTW), leading to a novel prewarping Siamese network (PSN) optimized with a local embedding loss. PSN learns a feature space that preserves the temporal location-wise distances of local structures. Local embedding, along with the alignment conditions of DTW, imposes a temporal consistency constraint on the sequence-level distance measure while achieving invariance as regards non-linear distortions. Validation on online signature verification datasets demonstrates the advantage of our framework over existing techniques that use either handcrafted or learned feature representations.

[1]  Julian Fierrez,et al.  Exploring Recurrent Neural Networks for On-Line Handwritten Signature Biometrics , 2018, IEEE Access.

[2]  Bagher BabaAli,et al.  Usage of autoencoders and Siamese networks for online handwritten signature verification , 2017, Neural Computing and Applications.

[3]  Miguel Angel Ferrer-Ballester,et al.  On-line signature recognition through the combination of real dynamic data and synthetically generated static data , 2015, Pattern Recognit..

[4]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Giorgos Tolias,et al.  Fine-Tuning CNN Image Retrieval with No Human Annotation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Carlos Vivaracho-Pascual,et al.  An efficient low cost approach for on-line signature recognition based on length normalization and fractional distances , 2009, Pattern Recognit..

[7]  Julian Fiérrez,et al.  Mobile signature verification: feature robustness and performance comparison , 2014, IET Biom..

[8]  Julian Fiérrez,et al.  Preprocessing and Feature Selection for Improved Sensor Interoperability in Online Biometric Signature Verification , 2015, IEEE Access.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Loris Nanni,et al.  A novel local on-line signature verification system , 2008, Pattern Recognit. Lett..

[11]  Endra,et al.  Online Signature Verification on Mobile Devices , 2015 .

[12]  Julian Fiérrez,et al.  Enhanced on-line signature verification based on skilled forgery detection using Sigma-LogNormal Features , 2015, 2015 International Conference on Biometrics (ICB).

[13]  Wenxiong Kang,et al.  Information Divergence-Based Matching Strategy for Online Signature Verification , 2018, IEEE Transactions on Information Forensics and Security.

[14]  Julian Fiérrez,et al.  HMM-based on-line signature verification: Feature extraction and signature modeling , 2007, Pattern Recognit. Lett..

[15]  Réjean Plamondon,et al.  Dynamic Signature Verification System Based on One Real Signature , 2018, IEEE Transactions on Cybernetics.

[16]  Berrin A. Yanikoglu,et al.  SUSIG: an on-line signature database, associated protocols and benchmark results , 2008, Pattern Analysis and Applications.

[17]  Berrin A. Yanikoglu,et al.  Online Signature Verification Using Fourier Descriptors , 2009, EURASIP J. Adv. Signal Process..

[18]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Miguel Angel Ferrer-Ballester,et al.  Robust score normalization for DTW-based on-line signature verification , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[20]  Berrin A. Yanikoglu,et al.  Identity authentication using improved online signature verification method , 2005, Pattern Recognit. Lett..

[21]  Wataru Ohyama,et al.  ICDAR 2013 Competitions on Signature Verification and Writer Identification for On- and Offline Skilled Forgeries (SigWiComp 2013) , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[22]  Marcos Faúndez-Zanuy,et al.  On-line signature recognition based on VQ-DTW , 2007, Pattern Recognit..

[23]  Julian Fiérrez,et al.  Improving the Enrollment in Dynamic Signature Verfication with Synthetic Samples , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[24]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[25]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[26]  Lianwen Jin,et al.  Online Signature Verification Using Recurrent Neural Network and Length-Normalized Path Signature Descriptor , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[27]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[28]  Marcus Liwicki,et al.  ICDAR2015 competition on signature verification and writer identification for on- and off-line skilled forgeries (SigWIcomp2015) , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[29]  Leszek Rutkowski,et al.  A new algorithm for identity verification based on the analysis of a handwritten dynamic signature , 2016, Appl. Soft Comput..

[30]  Miguel Angel Ferrer-Ballester,et al.  Towards an automatic on-line signature verifier using only one reference per signer , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[31]  Wenjie Pei,et al.  Models for supervised learning in sequence data , 2018 .

[32]  Enrique Argones-Rúa,et al.  Online Signature Verification Based on Generative Models , 2012, IEEE Trans. Syst. Man Cybern. Part B.

[33]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[34]  Damon L. Woodard,et al.  Deep Learning for Biometrics , 2018, ACM Comput. Surv..