SVC-onGoing: Signature Verification Competition

This article presents SVC-onGoing, an on-going competition for on-line signature verification where researchers can easily benchmark their systems against the state of the art in an open common platform using large-scale public databases, such as DeepSignDB and SVC2021 EvalDB, and standard experimental protocols. SVC-onGoing is based on the ICDAR 2021 Competition on On-Line Signature Verification (SVC 2021), which has been extended to allow participants anytime. The goal of SVC-onGoing is to evaluate the limits of on-line signature verification systems on popular scenarios (office/mobile) and writing inputs (stylus/finger) through large-scale public databases. Three different tasks are considered in the competition, simulating realistic scenarios as both random and skilled forgeries are simultaneously considered on each task. The results obtained in SVC-onGoing prove the high potential of deep learning methods in comparison with traditional methods. In particular, the best signature verification system has obtained Equal Error Rate (EER) values of 3.33% (Task 1), 7.41% (Task 2), and 6.04% (Task 3). Future studies in the field should be oriented to improve the performance of signature verification systems on the challenging mobile scenarios of SVC-onGoing in which several mobile devices and the finger are used during the signature acquisition.

[1]  Julian Fierrez,et al.  Exploring Recurrent Neural Networks for On-Line Handwritten Signature Biometrics , 2018, IEEE Access.

[2]  Kunio Kashino,et al.  Deep Dynamic Time Warping: End-to-End Local Representation Learning for Online Signature Verification , 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[3]  Julian Fierrez,et al.  BioTouchPass2: Touchscreen Password Biometrics Using Time-Aligned Recurrent Neural Networks , 2020, IEEE Transactions on Information Forensics and Security.

[4]  Seiichiro Hangai,et al.  Signature Matching , 2015, Encyclopedia of Biometrics.

[5]  Valentín Cardeñoso-Payo,et al.  BioSecure signature evaluation campaign (BSEC'2009): Evaluating online signature algorithms depending on the quality of signatures , 2012, Pattern Recognit..

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  B. Dorizzi,et al.  A Novel Personal Entropy Measure confronted with Online Signature Verification Systems' Performance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[8]  Julian Fierrez,et al.  Aging in Biometrics: An Experimental Analysis on On-Line Signature , 2013, PloS one.

[9]  Miguel Angel Ferrer-Ballester,et al.  A Perspective Analysis of Handwritten Signature Technology , 2019, ACM Comput. Surv..

[10]  Julian Fiérrez,et al.  Feature Selection Based on Genetic Algorithms for On-Line Signature Verification , 2007, 2007 IEEE Workshop on Automatic Identification Advanced Technologies.

[11]  Réjean Plamondon,et al.  Dynamic Signature Verification System Based on One Real Signature , 2018, IEEE Transactions on Cybernetics.

[12]  Julian Fiérrez,et al.  DeepSignCX: Signature Complexity Detection using Recurrent Neural Networks , 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[13]  Loris Nanni,et al.  An On-Line Signature Verification System Based on Fusion of Local and Global Information , 2005, AVBPA.

[14]  Imran Siddiqi,et al.  Towards the design of an offline signature verifier based on a small number of genuine samples for training , 2018, Expert Syst. Appl..

[15]  Marcus Liwicki,et al.  Signature Verification Competition for Online and Offline Skilled Forgeries (SigComp2011) , 2011, 2011 International Conference on Document Analysis and Recognition.

[16]  Nasir D. Memon,et al.  Online Signature Verification on Mobile Devices , 2014, IEEE Transactions on Information Forensics and Security.

[17]  Julian Fiérrez,et al.  Sensor Interoperability and Fusion in Signature Verification: A Case Study Using Tablet PC , 2005, IWBRS.

[18]  Julian Fiérrez,et al.  Improving the Enrollment in Dynamic Signature Verfication with Synthetic Samples , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[19]  Andrey Kormilitzin,et al.  A Primer on the Signature Method in Machine Learning , 2016, ArXiv.

[20]  Aythami Morales,et al.  DeepWriteSYN: On-Line Handwriting Synthesis via Deep Short-Term Representations , 2020, AAAI.

[21]  Marcus Liwicki,et al.  ICDAR2015 competition on signature verification and writer identification for on- and off-line skilled forgeries (SigWIcomp2015) , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[22]  Miguel A. Ferrer,et al.  Handwriting Biometrics: Applications and Future Trends in e-Security and e-Health , 2020, Cognitive Computation.

[23]  Miguel Angel Ferrer-Ballester,et al.  Dynamically enhanced static handwriting representation for Parkinson's disease detection , 2019, Pattern Recognit. Lett..

[24]  Wataru Ohyama,et al.  ICDAR 2013 Competitions on Signature Verification and Writer Identification for On- and Offline Skilled Forgeries (SigWiComp 2013) , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[25]  I. A. Hodashinsky,et al.  Bagged ensemble of fuzzy classifiers and feature selection for handwritten signature verification , 2019 .

[26]  Bagher BabaAli,et al.  Usage of autoencoders and Siamese networks for online handwritten signature verification , 2017, Neural Computing and Applications.

[27]  Julian Fiérrez,et al.  Biometric Template Storage With Blockchain: A First Look Into Cost and Performance Tradeoffs , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[28]  Hassiba Nemmour,et al.  Handwritten signature verification using the quad-tree histogram of templates and a Support Vector-based artificial immune classification , 2017, Image Vis. Comput..

[29]  Miguel Angel Ferrer-Ballester,et al.  Generation of Enhanced Synthetic Off-Line Signatures Based on Real On-Line Data , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[30]  F. Deravi,et al.  Touch-dynamics based Behavioural Biometrics on Mobile Devices – A Review from a Usability and Performance Perspective , 2020, ACM Comput. Surv..

[31]  Julian Fiérrez,et al.  Exploiting complexity in pen- and touch-based signature biometrics , 2020, International Journal on Document Analysis and Recognition (IJDAR).

[32]  Aythami Morales,et al.  ICDAR 2021 Competition on On-Line Signature Verification , 2021, ICDAR.

[33]  V. L. Blankers,et al.  ICDAR 2009 Signature Verification Competition , 2009, ICDAR.

[34]  Julian Fierrez,et al.  DeepSign: Deep On-Line Signature Verification , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[35]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[36]  Miguel Angel Ferrer-Ballester,et al.  On-line signature recognition through the combination of real dynamic data and synthetically generated static data , 2015, Pattern Recognit..

[37]  Julian Fierrez,et al.  Reducing the template ageing effect in on-line signature biometrics , 2019, IET Biom..

[38]  Songxuan Lai,et al.  SynSig2Vec: Forgery-Free Learning of Dynamic Signature Representations by Sigma Lognormal-Based Synthesis and 1D CNN , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Arun Ross,et al.  Accuracy evaluation of handwritten signature verification: Rethinking the random-skilled forgeries dichotomy , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[40]  Julian Fiérrez,et al.  Presentation Attacks in Signature Biometrics: Types and Introduction to Attack Detection , 2019, Handbook of Biometric Anti-Spoofing, 2nd Ed..

[41]  Julian Fiérrez,et al.  Mobile signature verification: feature robustness and performance comparison , 2014, IET Biom..

[42]  Emrah Hancer,et al.  A wrapper metaheuristic framework for handwritten signature verification , 2021, Soft Computing.

[43]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[44]  Umapada Pal,et al.  ICFHR 2020 Competition on Short answer ASsessment and Thai student SIGnature and Name COMponents Recognition and Verification (SASIGCOM 2020) , 2020, 2020 17th International Conference on Frontiers in Handwriting Recognition (ICFHR).

[45]  Julian Fiérrez,et al.  Preprocessing and Feature Selection for Improved Sensor Interoperability in Online Biometric Signature Verification , 2015, IEEE Access.

[46]  Marco Cuturi,et al.  Soft-DTW: a Differentiable Loss Function for Time-Series , 2017, ICML.

[47]  Lianwen Jin,et al.  SynSig2Vec: Learning Representations from Synthetic Dynamic Signatures for Real-world Verification , 2019, AAAI.

[48]  Lianwen Jin,et al.  Recurrent Adaptation Networks for Online Signature Verification , 2019, IEEE Transactions on Information Forensics and Security.

[49]  Margit Antal,et al.  Online Signature Verification on MOBISIG Finger-Drawn Signature Corpus , 2018, Mob. Inf. Syst..

[50]  Julian Fiérrez,et al.  Towards mobile authentication using dynamic signature verification: Useful features and performance evaluation , 2008, 2008 19th International Conference on Pattern Recognition.

[51]  Julian Fierrez,et al.  Benchmarking desktop and mobile handwriting across COTS devices: The e-BioSign biometric database , 2017, PloS one.

[52]  Javier Garrido Salas,et al.  BiosecurID: a multimodal biometric database , 2009, Pattern Analysis and Applications.

[53]  Anna Veronika Dorogush,et al.  CatBoost: unbiased boosting with categorical features , 2017, NeurIPS.

[54]  Miguel Angel Ferrer-Ballester,et al.  Offline geometric parameters for automatic signature verification using fixed-point arithmetic , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.