SynSig2Vec: Learning Representations from Synthetic Dynamic Signatures for Real-world Verification

An open research problem in automatic signature verification is the skilled forgery attacks. However, the skilled forgeries are very difficult to acquire for representation learning. To tackle this issue, this paper proposes to learn dynamic signature representations through ranking synthesized signatures. First, a neuromotor inspired signature synthesis method is proposed to synthesize signatures with different distortion levels for any template signature. Then, given the templates, we construct a lightweight one-dimensional convolutional network to learn to rank the synthesized samples, and directly optimize the average precision of the ranking to exploit relative and fine-grained signature similarities. Finally, after training, fixed-length representations can be extracted from dynamic signatures of variable lengths for verification. One highlight of our method is that it requires neither skilled nor random forgeries for training, yet it surpasses the state-of-the-art by a large margin on two public benchmarks.

[1]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  PlamondonRéjean,et al.  On-Line and Off-Line Handwriting Recognition , 2000 .

[3]  Kunio Kashino,et al.  Prewarping Siamese Network: Learning Local Representations for Online Signature Verification , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Sepp Hochreiter,et al.  Self-Normalizing Neural Networks , 2017, NIPS.

[5]  Miguel Angel Ferrer-Ballester,et al.  A Perspective Analysis of Handwritten Signature Technology , 2019, ACM Comput. Surv..

[6]  Bagher BabaAli,et al.  Usage of autoencoders and Siamese networks for online handwritten signature verification , 2017, Neural Computing and Applications.

[7]  Ho-Jin Choi,et al.  Robust Online Signature Verification Using Long-term Recurrent Convolutional Network , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).

[8]  Réjean Plamondon,et al.  Dynamic Signature Verification System Based on One Real Signature , 2018, IEEE Transactions on Cybernetics.

[9]  Réjean Plamondon,et al.  A sigma-lognormal model-based approach to generating large synthetic online handwriting sample databases , 2017, International Journal on Document Analysis and Recognition (IJDAR).

[10]  D. S. Guru,et al.  Interval valued symbolic representation of writer dependent features for online signature verification , 2017, Expert Syst. Appl..

[11]  Réjean Plamondon,et al.  Automatic signature verification and writer identification - the state of the art , 1989, Pattern Recognit..

[12]  Suresh Sundaram,et al.  On the Exploration of Information From the DTW Cost Matrix for Online Signature Verification , 2018, IEEE Transactions on Cybernetics.

[13]  Réjean Plamondon,et al.  Development of a Sigma-Lognormal representation for on-line signatures , 2009, Pattern Recognit..

[14]  Filip Radlinski,et al.  A support vector method for optimizing average precision , 2007, SIGIR.

[15]  Yang Song,et al.  Training Deep Neural Networks via Direct Loss Minimization , 2015, ICML.

[16]  Xiaoyu Song,et al.  Signature alignment based on GMM for on-line signature verification , 2017, Pattern Recognit..

[17]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Lianwen Jin,et al.  Recurrent Adaptation Networks for Online Signature Verification , 2019, IEEE Transactions on Information Forensics and Security.

[19]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[20]  Réjean Plamondon,et al.  A kinematic theory of rapid human movements , 1995, Biological Cybernetics.

[21]  Julian Fierrez,et al.  Exploring Recurrent Neural Networks for On-Line Handwritten Signature Biometrics , 2018, IEEE Access.

[22]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[23]  Raquel Urtasun,et al.  Few-Shot Learning Through an Information Retrieval Lens , 2017, NIPS.