BioSecure signature evaluation campaign (BSEC'2009): Evaluating online signature algorithms depending on the quality of signatures

In this paper, we present the main results of the BioSecure Signature Evaluation Campaign (BSEC'2009). The objective of BSEC'2009 was to evaluate different online signature algorithms on two tasks: the first one aims at studying the influence of acquisition conditions (digitizing tablet or PDA) on systems' performance; the second one aims at studying the impact of information content in signatures on systems' performance. In BSEC'2009, the two BioSecure Data Sets DS2 and DS3 are used for tests, both containing data of the same 382 people, acquired respectively on a digitizing tablet and on a PDA. The results of the 12 systems involved in this evaluation campaign are reported and analyzed in detail in this paper. Experimental results reveal a 2.2% EER for skilled forgeries and a 0.51% EER for random forgeries on DS2; and a 4.97% EER for skilled forgeries and a 0.55% EER for random forgeries on DS3.

[1]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[2]  Julian Fiérrez,et al.  Quality-Based Conditional Processing in Multi-Biometrics: Application to Sensor Interoperability , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[3]  Bernadette Dorizzi,et al.  Online Handwritten Signature Verification , 2009 .

[4]  Sharath Pankanti,et al.  Error analysis of pattern recognition systems - the subsets bootstrap , 2004, Comput. Vis. Image Underst..

[5]  Alvin F. Martin,et al.  The DET curve in assessment of detection task performance , 1997, EUROSPEECH.

[6]  Berrin A. Yanikoglu,et al.  Identity authentication using improved online signature verification method , 2005, Pattern Recognit. Lett..

[7]  Hazem M. Abbas,et al.  Enhanced DTW based on-line signature verification , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[8]  Anil K. Jain,et al.  On-line signature verification, , 2002, Pattern Recognit..

[9]  Bernadette Dorizzi,et al.  Fingerprint and On-Line Signature Verification Competitions at ICB 2009 , 2009, ICB.

[10]  Eamonn J. Keogh,et al.  Dimensionality Reduction for Fast Similarity Search in Large Time Series Databases , 2001, Knowledge and Information Systems.

[11]  Bernadette Dorizzi,et al.  A Novel Criterion for Writer Enrolment Based on a Time-Normalized Signature Sample Entropy Measure , 2009, EURASIP J. Adv. Signal Process..

[12]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[13]  B. Dorizzi,et al.  A Novel Personal Entropy Measure confronted with Online Signature Verification Systems' Performance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[14]  Julian Fiérrez,et al.  Towards mobile authentication using dynamic signature verification: Useful features and performance evaluation , 2008, 2008 19th International Conference on Pattern Recognition.

[15]  Marcos Faundez-Zanuy,et al.  On-line signature verification system with failure to enrol management , 2009, Pattern Recognit..

[16]  Loris Nanni,et al.  An On-Line Signature Verification System Based on Fusion of Local and Global Information , 2005, AVBPA.

[17]  Alejandro F. Frangi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. , 2022 .

[18]  V. L. Blankers,et al.  ICDAR 2009 Signature Verification Competition , 2009, ICDAR.

[19]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[20]  Valentín Cardeñoso-Payo,et al.  Practical On-Line Signature Verification , 2009, ICB.

[21]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[22]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[24]  Juan Manuel,et al.  Uso de la firma manuscrita dinámica para el reconocimiento biométrico de personas en escenarios prácticos , 2011 .

[25]  Julian Fiérrez,et al.  HMM-based on-line signature verification: Feature extraction and signature modeling , 2007, Pattern Recognit. Lett..

[26]  Marcos Faúndez-Zanuy,et al.  Biometric dispersion matcher , 2008, Pattern Recognit..

[27]  Bernadette Dorizzi,et al.  On Using the Viterbi Path Along With HMM Likelihood Information for Online Signature Verification , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[28]  Takashi Matsumoto,et al.  Online signature verification algorithm with a user-specific global-parameter fusion model , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.