SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification

Offline signature verification is one of the most challenging tasks in biometrics and document forensics. Unlike other verification problems, it needs to model minute but critical details between genuine and forged signatures, because a skilled falsification might often resembles the real signature with small deformation. This verification task is even harder in writer independent scenarios which is undeniably fiscal for realistic cases. In this paper, we model an offline writer independent signature verification task with a convolutional Siamese network. Siamese networks are twin networks with shared weights, which can be trained to learn a feature space where similar observations are placed in proximity. This is achieved by exposing the network to a pair of similar and dissimilar observations and minimizing the Euclidean distance between similar pairs while simultaneously maximizing it between dissimilar pairs. Experiments conducted on cross-domain datasets emphasize the capability of our network to model forgery in different languages (scripts) and handwriting styles. Moreover, our designed Siamese network, named SigNet, exceeds the state-of-the-art results on most of the benchmark signature datasets, which paves the way for further research in this direction.

[1]  Javier Ruiz-del-Solar,et al.  Offline Signature Verification Using Local Interest Points and Descriptors , 2008, CIARP.

[2]  Honggang Zhang,et al.  Sketch-based image retrieval via Siamese convolutional neural network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[3]  Bhabatosh Chanda,et al.  Writer-independent off-line signature verification using surroundedness feature , 2012, Pattern Recognit. Lett..

[4]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Pietro Perona,et al.  Visual Identification by Signature Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Alireza Alaei,et al.  Performance of an Off-Line Signature Verification Method Based on Texture Features on a Large Indic-Script Signature Dataset , 2016, 2016 12th IAPR Workshop on Document Analysis Systems (DAS).

[7]  Gregory R. Koch,et al.  Siamese Neural Networks for One-Shot Image Recognition , 2015 .

[8]  Miguel Angel Ferrer-Ballester,et al.  Offline geometric parameters for automatic signature verification using fixed-point arithmetic , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Jesús Francisco Vargas-Bonilla,et al.  Off-line Handwritten Signature GPDS-960 Corpus , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[12]  Umapada Pal,et al.  Compact correlated features for writer independent signature verification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[13]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[14]  Siyuan Chen,et al.  Machine Learning for Signature Verification , 2006, ICVGIP.

[15]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  M. Narasimha Murty,et al.  Off-line signature verification using genetically optimized weighted features , 1999, Pattern Recognit..

[17]  Luiz Eduardo Soares de Oliveira,et al.  Reducing forgeries in writer-independent off-line signature verification through ensemble of classifiers , 2010, Pattern Recognit..

[18]  G. Dimauro,et al.  A Multi-Expert Signature Verification System for Bankcheck Processing , 1997, Int. J. Pattern Recognit. Artif. Intell..

[19]  Hong Yan,et al.  Off-line signature verification based on geometric feature extraction and neural network classification , 1997, Pattern Recognit..

[20]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[21]  Siyuan Chen,et al.  A New Off-line Signature Verification Method based on Graph , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Miguel Angel Ferrer-Ballester,et al.  Synthetic off-line signature image generation , 2013, 2013 International Conference on Biometrics (ICB).

[23]  Sargur N. Srihari,et al.  Offline Signature Verification And Identification Using Distance Statistics , 2004, Int. J. Pattern Recognit. Artif. Intell..

[24]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).