Hybrid User-Independent and User-Dependent Offline Signature Verification with a Two-Channel CNN

Signature verification task needs relevant signature representations to achieve low error rates. Many signature representations have been proposed so far. In this work we propose a hybrid user-independent/dependent offline signature verification technique with a two-channel convolutional neural network (CNN) both for verification and feature extraction. Signature pairs are input to the CNN as two channels of one image, where the first channel always represents a reference signature and the second channel represents a query signature. We decrease the image size through the network by keeping the convolution stride parameter large enough. Global average pooling is applied to decrease the dimensionality to 200 at the end of locally connected layers. We utilize the CNN as a feature extractor and report 4.13% equal error rate (EER) considering 12 reference signatures with the proposed 200-dimensional representation, compared to 3.66% of a recently proposed technique with 2048-dimensional representation using the same experimental protocol. When the two methods are combined at score level, more than 50% improvement (1.76% EER) is achieved demonstrating the complementarity of them. Sensitivity of the model to gray-level and binary images is investigated in detail. One model is trained using gray-level images and the other is trained using binary images. It is shown that the availability of gray-level information in train and test data decreases the EER e.g. from 11.86% to 4.13%.

[1]  Luiz Eduardo Soares de Oliveira,et al.  Learning features for offline handwritten signature verification using deep convolutional neural networks , 2017, Pattern Recognit..

[2]  Yan Cui,et al.  Multi-phase Offline Signature Verification System Using Deep Convolutional Generative Adversarial Networks , 2016, 2016 9th International Symposium on Computational Intelligence and Design (ISCID).

[3]  Miguel Angel Ferrer-Ballester,et al.  Offline geometric parameters for automatic signature verification using fixed-point arithmetic , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jesús Francisco Vargas-Bonilla,et al.  The 4NSigComp2010 Off-line Signature Verification Competition: Scenario 2 , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[5]  Babak Nadjar Araabi,et al.  Deep Multitask Metric Learning for Offline Signature Verification , 2016, Pattern Recognit. Lett..

[6]  Jesús Francisco Vargas-Bonilla,et al.  Robustness of Offline Signature Verification Based on Gray Level Features , 2012, IEEE Transactions on Information Forensics and Security.

[7]  Nikos Komodakis,et al.  Deep compare: A study on using convolutional neural networks to compare image patches , 2017, Comput. Vis. Image Underst..

[8]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[9]  Bernardete Ribeiro,et al.  Deep Learning Networks for Off-Line Handwritten Signature Recognition , 2011, CIARP.

[10]  Mustafa Berkay Yilmaz,et al.  Offline signature verification with user-based and global classifiers of local features (Kullanıcı bazlı ve evrensel yerel öznitelik sınıflandırıcıları ile çevrimdışı imza doğrulama) , 2015 .

[11]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[12]  Mohammad Teshnehlab,et al.  Persian Signature Verification using Convolutional Neural Networks , 2012 .

[13]  Zhenhua Guo,et al.  Offline Signature Verification Using Local Features and Decision Trees , 2017, Int. J. Pattern Recognit. Artif. Intell..

[14]  Nikos Komodakis,et al.  Learning to compare image patches via convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[16]  Y. Chibani,et al.  One-class versus bi-class SVM classifier for off-line signature verification , 2012, 2012 International Conference on Multimedia Computing and Systems.

[17]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[18]  Mustafa Berkay Ylmaz,et al.  Score level fusion of classifiers in off-line signature verification , 2016 .

[19]  Umapada Pal,et al.  SigNet: Convolutional Siamese Network for Writer Independent Offline Signature Verification , 2017, ArXiv.

[20]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[21]  Ilias Theodorakopoulos,et al.  Parsimonious Coding and Verification of Offline Handwritten Signatures , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[23]  Yann LeCun,et al.  Stereo Matching by Training a Convolutional Neural Network to Compare Image Patches , 2015, J. Mach. Learn. Res..