Inverse Discriminative Networks for Handwritten Signature Verification

Handwritten signature verification is an important technique for many financial, commercial, and forensic applications. In this paper, we propose an inverse discriminative network (IDN) for writer-independent handwritten signature verification, which aims to determine whether a test signature is genuine or forged compared to the reference signature. The IDN model contains four weight-shared neural network streams, of which two receiving the original signature images are the discriminative streams and the other two addressing the gray-inverted images form the inverse streams. Multiple paths of attention modules connect the discriminative streams and the inverse streams to propagate messages. With the inverse streams and the multi-path attention modules, the IDN model intensifies the effective information of signature verification. Since there was no proper Chinese signature dataset in the community, we collected a large-scale Chinese signature dataset with approximately 29,000 images of 749 individuals’ signatures. We test our method on the Chinese signature dataset and other three signature datasets of different languages: CEDAR, BHSig-B, and BHSig-H. Experiments prove the strength and potential of our method.

[1]  Mustafa Berkay Yilmaz,et al.  Score level fusion of classifiers in off-line signature verification , 2016, Inf. Fusion.

[2]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[4]  Sargur N. Srihari,et al.  Offline Signature Verification And Identification Using Distance Statistics , 2004, Int. J. Pattern Recognit. Artif. Intell..

[5]  Javier Ruiz-del-Solar,et al.  Offline Signature Verification Using Local Interest Points and Descriptors , 2008, CIARP.

[6]  Bhabatosh Chanda,et al.  Writer-independent off-line signature verification using surroundedness feature , 2012, Pattern Recognit. Lett..

[7]  Umapada Pal,et al.  Compact correlated features for writer independent signature verification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[8]  Bhabatosh Chanda,et al.  A writer-independent off-line signature verification system based on signature morphology , 2010, IITM '10.

[9]  A. El-Yacoubi,et al.  Off-line signature verification using HMMs and cross-validation , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[10]  Siyuan Chen,et al.  A New Off-line Signature Verification Method based on Graph , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Mustafa Berkay Yilmaz,et al.  Hybrid User-Independent and User-Dependent Offline Signature Verification with a Two-Channel CNN , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Miguel Angel Ferrer-Ballester,et al.  Synthetic off-line signature image generation , 2013, 2013 International Conference on Biometrics (ICB).

[13]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[14]  Mustafa Berkay Yilmaz,et al.  Offline signature verification using classifier combination of HOG and LBP features , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[15]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Umapada Pal,et al.  SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification , 2017, ArXiv.

[17]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Christoph Meinel,et al.  Signature Embedding: Writer Independent Offline Signature Verification with Deep Metric Learning , 2016, ISVC.

[19]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[20]  Mohammad Teshnehlab,et al.  Persian Signature Verification using Convolutional Neural Networks , 2012 .

[21]  Yan Cui,et al.  Multi-phase Offline Signature Verification System Using Deep Convolutional Generative Adversarial Networks , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[22]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[23]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Ben Wang,et al.  Reverse Attention for Salient Object Detection , 2018, ECCV.

[25]  Tat-Seng Chua,et al.  SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[26]  Luiz Eduardo Soares de Oliveira,et al.  Learning features for offline handwritten signature verification using deep convolutional neural networks , 2017, Pattern Recognit..

[27]  H. Baltzakisa,et al.  A new signature verification technique based on a two-stage neural network classifier , 2000 .

[28]  Luiz Eduardo Soares de Oliveira,et al.  Writer-independent feature learning for Offline Signature Verification using Deep Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[29]  Youcef Chibani,et al.  The effective use of the one-class SVM classifier for handwritten signature verification based on writer-independent parameters , 2015, Pattern Recognit..

[30]  Loris Nanni,et al.  An On-Line Signature Verification System Based on Fusion of Local and Global Information , 2005, AVBPA.

[31]  Hassiba Nemmour,et al.  Combination of OC-LBP and Longest Run Features for Off-Line Signature Verification , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[32]  Alireza Alaei,et al.  Performance of an Off-Line Signature Verification Method Based on Texture Features on a Large Indic-Script Signature Dataset , 2016, 2016 12th IAPR Workshop on Document Analysis Systems (DAS).

[33]  Ilias Theodorakopoulos,et al.  Offline Handwritten Signature Modeling and Verification Based on Archetypal Analysis , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[34]  Flávio Bortolozzi,et al.  An Off-Line Signature Verification System Using HMM and Graphometric Features , 2001 .

[35]  B. H. Shekar,et al.  Off-line signature verification based on chain code histogram and Support Vector Machine , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[36]  Gabe Alvarez,et al.  Offline Signature Verification with Convolutional Neural Networks , 2016 .

[37]  Miguel Angel Ferrer-Ballester,et al.  Offline geometric parameters for automatic signature verification using fixed-point arithmetic , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Ye Wang,et al.  Semantic Segmentation with Reverse Attention , 2017, BMVC.