Enhancing Security on Touch-Screen Sensors with Augmented Handwritten Signatures

We aim at enhancing personal identity security on mobile touch-screen sensors by augmenting handwritten signatures with specific additional information at the enrollment phase. Our former works on several available and private data sets acquired on different sensors demonstrated that there are different categories of signatures that emerge automatically with clustering techniques, based on an entropy-based data quality measure. The behavior of such categories is totally different when confronted to automatic verification systems in terms of vulnerability to attacks. In this paper, we propose a novel and original strategy to reinforce identity security by enhancing signature resistance to attacks, assessed per signature category, both in terms of data quality and verification performance. This strategy operates upstream from the verification system, at the sensor level, by enriching the information content of signatures with personal handwritten inputs of different types. We study this strategy on different signature types of 74 users, acquired in uncontrolled mobile conditions on a largely deployed mobile touch-screen sensor. Our analysis per writer category revealed that adding alphanumeric (date) and handwriting (place) information to the usual signature is the most powerful augmented signature type in terms of verification performance. The relative improvement for all user categories is of at least 93% compared to the usual signature.

[1]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Nasir D. Memon,et al.  Online Signature Verification on Mobile Devices , 2014, IEEE Transactions on Information Forensics and Security.

[3]  Bernadette Dorizzi,et al.  On-line Signature Verification on a Mobile Platform , 2010, MobiCASE.

[4]  Margit Antal,et al.  Online Signature Verification on MOBISIG Finger-Drawn Signature Corpus , 2018, Mob. Inf. Syst..

[5]  Chang-Ho Seo,et al.  Forged Signature Distinction Using Convolutional Neural Network for Feature Extraction , 2018 .

[6]  Berrin A. Yanikoglu,et al.  SUSIG: an on-line signature database, associated protocols and benchmark results , 2008, Pattern Analysis and Applications.

[7]  Raul Sánchez-Reillo,et al.  Handwritten signature recognition in mobile scenarios: Performance evaluation , 2012, 2012 IEEE International Carnahan Conference on Security Technology (ICCST).

[8]  Javier Garrido Salas,et al.  BiosecurID: a multimodal biometric database , 2009, Pattern Analysis and Applications.

[9]  Sonia Garcia-Salicetti,et al.  On Hunting Animals of the Biometric Menagerie for Online Signature , 2016, PloS one.

[10]  Julian Fiérrez,et al.  The DooDB Graphical Password Database: Data Analysis and Benchmark Results , 2013, IEEE Access.

[11]  B. Dorizzi,et al.  A client-entropy measure for On-line Signatures , 2008, 2008 Biometrics Symposium.

[12]  Michael Fairhurst,et al.  Sample Selection for Optimising Signature Enrolment , 2006 .

[13]  Julian Fiérrez,et al.  Mobile signature verification: feature robustness and performance comparison , 2014, IET Biom..

[14]  Gérard Chollet,et al.  BIOMET: A Multimodal Person Authentication Database Including Face, Voice, Fingerprint, Hand and Signature Modalities , 2003, AVBPA.

[15]  Bernadette Dorizzi,et al.  On Using the Viterbi Path Along With HMM Likelihood Information for Online Signature Verification , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[16]  Chandra Sekhar Vorugunti,et al.  OSVNet: Convolutional Siamese Network for Writer Independent Online Signature Verification , 2019, 2019 International Conference on Document Analysis and Recognition (ICDAR).

[17]  Valentín Cardeñoso-Payo,et al.  BioSecure signature evaluation campaign (BSEC'2009): Evaluating online signature algorithms depending on the quality of signatures , 2012, Pattern Recognit..

[18]  Miguel Angel Ferrer-Ballester,et al.  A Perspective Analysis of Handwritten Signature Technology , 2019, ACM Comput. Surv..

[19]  Bernadette Dorizzi,et al.  A Novel Criterion for Writer Enrolment Based on a Time-Normalized Signature Sample Entropy Measure , 2009, EURASIP J. Adv. Signal Process..

[20]  Bernadette Dorizzi,et al.  Online Handwritten Signature Verification , 2009 .

[21]  Emile H. L. Aarts,et al.  On-line signature verification with hidden Markov models , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  Margit Antal,et al.  Finger or Stylus: Their Impact on the Performance of On-line Signature Verification Systems , 2017, MACRo.

[23]  Valentín Cardeñoso-Payo,et al.  BioSecure Signature Evaluation Campaign (ESRA'2011): evaluating systems on quality-based categories of skilled forgeries , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[24]  Lianwen Jin,et al.  Online Signature Verification Using Recurrent Neural Network and Length-Normalized Path Signature Descriptor , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[25]  Sonia Garcia-Salicetti,et al.  Digitizing Tablet , 2009, Encyclopedia of Biometrics.

[26]  Julian Fierrez,et al.  Benchmarking desktop and mobile handwriting across COTS devices: The e-BioSign biometric database , 2017, PloS one.

[27]  B. Dorizzi,et al.  A Novel Personal Entropy Measure confronted with Online Signature Verification Systems' Performance , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[28]  Michael C. Fairhurst,et al.  Biosecure reference systems for on-line signature verification: A study of complementarity , 2007, Ann. des Télécommunications.

[29]  Giuseppe Pirlo,et al.  Automatic Signature Verification in the Mobile Cloud Scenario: Survey and Way Ahead , 2018, IEEE Transactions on Emerging Topics in Computing.

[30]  Alejandro F. Frangi,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. , 2022 .

[31]  Julian Fierrez,et al.  Exploring Recurrent Neural Networks for On-Line Handwritten Signature Biometrics , 2018, IEEE Access.

[32]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[33]  Sonia Garcia-Salicetti,et al.  A Signature Complexity Measure to Select Reference Signatures for Online Signature Verification , 2015, 2015 International Conference of the Biometrics Special Interest Group (BIOSIG).

[34]  Judith Liu-Jimenez,et al.  Performance evaluation of handwritten signature recognition in mobile environments , 2014, IET Biom..

[35]  Suraiya Jabin,et al.  Authentic mobile-biometric signature verification system , 2016, IET Biom..

[36]  Réjean Plamondon,et al.  How to detect problematic signers for automatic signature verification , 1989, Proceedings. International Carnahan Conference on Security Technology.

[37]  Sebastiano Impedovo,et al.  Selection of reference signatures for automatic signature verification , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[38]  Kunio Kashino,et al.  Prewarping Siamese Network: Learning Local Representations for Online Signature Verification , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[39]  Gérard Chollet,et al.  BioSecure Multimodal Evaluation Campaign 2007 (BMEC’2007) , 2009 .

[40]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[41]  Bernadette Dorizzi,et al.  On measuring forgery quality in online signatures , 2012, Pattern Recognit..

[42]  Julian Fiérrez,et al.  Towards mobile authentication using dynamic signature verification: Useful features and performance evaluation , 2008, 2008 19th International Conference on Pattern Recognition.

[43]  Judith Liu-Jimenez,et al.  Usability analysis of dynamic signature verification in mobile environments , 2013, 2013 International Conference of the BIOSIG Special Interest Group (BIOSIG).

[44]  V. L. Blankers,et al.  ICDAR 2009 Signature Verification Competition , 2009, ICDAR.

[45]  Sonia Garcia-Salicetti,et al.  Impact of Spatial Constraints when Signing in Uncontrolled Mobile Conditions , 2019, IH&MMSec.