Sequential Motif Profiles and Topological Plots for Offline Signature Verification

In spite of the overwhelming high-tech marvels and applications that rule our digital lives, the use of the handwritten signature is still recognized worldwide in government, personal and legal entities to be the most important behavioral biometric trait. A number of notable research approaches provide advanced results up to a certain point which allow us to assert with confidence that the performance attained by signature verification (SV) systems is comparable to those provided by any other biometric modality. Up to now, the mainstream trend for offline SV is shared between standard -or handcrafted- feature extraction methods and popular machine learning techniques, with typical examples ranging from sparse representation to Deep Learning. Recent progress in graph mining algorithms provide us with the prospect to re-evaluate the opportunity of utilizing graph representations by exploring corresponding graph features for offline SV. In this paper, inspired by the recent use of image visibility graphs for mapping images into networks, we introduce for the first time in offline SV literature their use as a parameter free, agnostic representation for exploring global as well as local information. Global properties of the sparsely located content of the shape of the signature image are encoded with topological information of the whole graph. In addition, local pixel patches are encoded by sequential visibility motifs-subgraphs of size four, to a low six dimensional motif profile vector. A number of pooling functions operate on the motif codes in a spatial pyramid context in order to create the final feature vector. The effectiveness of the proposed method is evaluated with the use of two popular datasets. The local visibility graph features are considered to be highly informative for SV; this is sustained by the corresponding results which are at least comparable with other classic state-of-the-art approaches.

[1]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  A. Bansal,et al.  Offline Signature Verification Using Critical Region Matching , 2008, 2008 Second International Conference on Future Generation Communication and Networking Symposia.

[3]  Kaspar Riesen,et al.  Approximate graph edit distance computation by means of bipartite graph matching , 2009, Image Vis. Comput..

[4]  Kurban Ubul,et al.  BoVW Based Feature Selection for Uyghur Offline Signature Verification , 2018, CCBR.

[5]  Lucas Lacasa,et al.  Sequential visibility-graph motifs. , 2015, Physical review. E.

[6]  Ilias Theodorakopoulos,et al.  Offline Handwritten Signature Modeling and Verification Based on Archetypal Analysis , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Julian Fierrez,et al.  Off-line Signature Verification Using Contour Features , 2008, ICFHR 2008.

[8]  Zhi-Qiang Jiang,et al.  Universal and nonuniversal allometric scaling behaviors in the visibility graphs of world stock market indices , 2009, 0910.2524.

[9]  Lucas Lacasa,et al.  Canonical horizontal visibility graphs are uniquely determined by their degree sequence , 2016, 1605.05222.

[10]  Siyuan Chen,et al.  A New Off-line Signature Verification Method based on Graph , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Mustafa Berkay Yilmaz,et al.  Hybrid User-Independent and User-Dependent Offline Signature Verification with a Two-Channel CNN , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Nasir D. Memon,et al.  Online Signature Verification on Mobile Devices , 2014, IEEE Transactions on Information Forensics and Security.

[13]  Luiz Eduardo Soares de Oliveira,et al.  Learning features for offline handwritten signature verification using deep convolutional neural networks , 2017, Pattern Recognit..

[14]  R. Nadarajan,et al.  A Fuzzy Hybrid Framework for Offline Signature Verification , 2013, PReMI.

[15]  Giuseppe Pirlo,et al.  Verification of Static Signatures by Optical Flow Analysis , 2013, IEEE Transactions on Human-Machine Systems.

[16]  Alireza Alaei,et al.  Performance of an Off-Line Signature Verification Method Based on Texture Features on a Large Indic-Script Signature Dataset , 2016, 2016 12th IAPR Workshop on Document Analysis Systems (DAS).

[17]  Ping Wei,et al.  Inverse Discriminative Networks for Handwritten Signature Verification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jesús Francisco Vargas-Bonilla,et al.  Robustness of Offline Signature Verification Based on Gray Level Features , 2012, IEEE Transactions on Information Forensics and Security.

[19]  Suresh Sundaram,et al.  An improved online writer identification framework using codebook descriptors , 2018, Pattern Recognit..

[20]  Youcef Chibani,et al.  One-Class Writer-Independent Offline Signature Verification Using Feature Dissimilarity Thresholding , 2016, IEEE Transactions on Information Forensics and Security.

[21]  Majid Nili Ahmadabadi,et al.  Multi-Representational Learning for Offline Signature Verification using Multi-Loss Snapshot Ensemble of CNNs , 2019, Expert Syst. Appl..

[22]  Hassiba Nemmour,et al.  New off-line Handwritten Signature Verification method based on Artificial Immune Recognition System , 2016, Expert Syst. Appl..

[23]  Mustafa Berkay Ylmaz,et al.  Score level fusion of classifiers in off-line signature verification , 2016 .

[24]  Manabu Okawa,et al.  Offline Signature Verification Based on Bag-of-VisualWords Model Using KAZE Features and Weighting Schemes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[25]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Raul Sánchez-Reillo,et al.  Handwritten signature recognition in mobile scenarios: Performance evaluation , 2012, 2012 IEEE International Carnahan Conference on Security Technology (ICCST).

[27]  Julian Fiérrez,et al.  Signature authentication based on human intervention: performance and complementarity with automatic systems , 2017, IET Biom..

[28]  Jesús Francisco Vargas-Bonilla,et al.  Off-line signature verification based on grey level information using texture features , 2011, Pattern Recognit..

[29]  Réjean Plamondon,et al.  Automatic signature verification and writer identification - the state of the art , 1989, Pattern Recognit..

[30]  Ilias Theodorakopoulos,et al.  Handwritten Signature Verification via Deep Sparse Coding Architecture , 2018, 2018 IEEE 13th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[31]  Roy Huber,et al.  Handwriting Identification: Facts and Fundamentals , 1999 .

[32]  Joachim Peinke,et al.  Fully developed turbulence in the view of horizontal visibility graphs , 2015, 1512.08200.

[33]  Réjean Plamondon,et al.  Automatic Signature Verification: The State of the Art - 1989-1993 , 1994, Int. J. Pattern Recognit. Artif. Intell..

[34]  Tetsushi Wakabayashi,et al.  Performance Analysis of the Gradient Feature and the Modified Direction Feature for Off-line Signature Verification , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[35]  Younes Akbari,et al.  Patch-based offline signature verification using one-class hierarchical deep learning , 2019, International Journal on Document Analysis and Recognition (IJDAR).

[36]  Babak Nadjar Araabi,et al.  UTSig: A Persian offline signature dataset , 2016, IET Biom..

[37]  Jacques Klein,et al.  Extracting Statistical Graph Features for Accurate and Efficient Time Series Classification , 2018, EDBT.

[38]  Umapada Pal,et al.  Compact correlated features for writer independent signature verification , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[39]  Lucas Lacasa,et al.  Visibility graphs of random scalar fields and spatial data. , 2017, Physical review. E.

[40]  Bhabatosh Chanda,et al.  A writer-independent off-line signature verification system based on signature morphology , 2010, IITM '10.

[41]  Giuseppe Pirlo,et al.  Automatic Signature Verification in the Mobile Cloud Scenario: Survey and Way Ahead , 2018, IEEE Transactions on Emerging Topics in Computing.

[42]  B. H. Shekar,et al.  Local Morphological Pattern Spectrum Based Approach for Off-line Signature Verification , 2013, PReMI.

[43]  M. Baca,et al.  Handwritten signature identification using basic concepts of graph theory , 2011 .

[44]  George Economou,et al.  Offline signature verification and quality characterization using poset-oriented grid features , 2016, Pattern Recognit..

[45]  Babak Nadjar Araabi,et al.  Deep Multitask Metric Learning for Offline Signature Verification , 2016, Pattern Recognit. Lett..

[46]  Hassiba Nemmour,et al.  Handwritten signature verification using the quad-tree histogram of templates and a Support Vector-based artificial immune classification , 2017, Image Vis. Comput..

[47]  Bhabatosh Chanda,et al.  Writer-independent off-line signature verification using surroundedness feature , 2012, Pattern Recognit. Lett..

[48]  Robert Sabourin,et al.  Dynamic selection of generative-discriminative ensembles for off-line signature verification , 2012, Pattern Recognit..

[49]  Robert Sabourin,et al.  Structural Interpretation of Handwritten Signature Images , 1994, Int. J. Pattern Recognit. Artif. Intell..

[50]  Alex Alexandridis,et al.  Writer independent offline signature verification based on asymmetric pixel relations and unrelated training-testing datasets , 2019, Expert Syst. Appl..

[51]  George Economou,et al.  Hierarchical Dictionary Learning and Sparse Coding for Static Signature Verification , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[52]  Manabu Okawa,et al.  Synergy of foreground-background images for feature extraction: Offline signature verification using Fisher vector with fused KAZE features , 2018, Pattern Recognit..

[53]  Niladri B. Puhan,et al.  Off-line signature verification: upper and lower envelope shape analysis using chord moments , 2014, IET Biom..

[54]  Bernardete Ribeiro,et al.  Deep Learning Networks for Off-Line Handwritten Signature Recognition , 2011, CIARP.

[55]  Mustafa Berkay Yilmaz,et al.  Recurrent Binary Patterns and CNNs for Offline Signature Verification , 2019, Advances in Intelligent Systems and Computing.

[56]  Miguel A. Ferrer,et al.  Static Signature Synthesis: A Neuromotor Inspired Approach for Biometrics , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Youcef Chibani,et al.  The effective use of the one-class SVM classifier for handwritten signature verification based on writer-independent parameters , 2015, Pattern Recognit..

[58]  Loris Nanni,et al.  An On-Line Signature Verification System Based on Fusion of Local and Global Information , 2005, AVBPA.

[59]  Anastasios L. Kesidis,et al.  A Comprehensive Study of Sparse Representation Techniques for Offline Signature Verification , 2018, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[60]  Lucas Lacasa,et al.  Visibility Graphs for Image Processing , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[61]  Lucas Lacasa,et al.  Sequential motif profile of natural visibility graphs. , 2016, Physical review. E.

[62]  F. Prêteux,et al.  Off-line signature verification by local granulometric size distributions , 1997 .

[63]  B. H. Shekar,et al.  Off-line signature verification based on chain code histogram and Support Vector Machine , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[64]  Marcus Liwicki,et al.  LOCAL FEATURES FOR OFF-LINE FORENSIC SIGNATURE VERIFICATION , 2014 .

[65]  Imran Siddiqi,et al.  Towards the design of an offline signature verifier based on a small number of genuine samples for training , 2018, Expert Syst. Appl..

[66]  Robert Sabourin,et al.  Fixed-sized representation learning from offline handwritten signatures of different sizes , 2018, International Journal on Document Analysis and Recognition (IJDAR).