KAZE features via fisher vector encoding for offline signature verification

The widespread use of handwritten signatures for identity authentication has resulted in a need for automated verification systems. However, there is still significant room for improvement in the performance of these automated systems when compared with the performance of human analysts, particularly forensic document examiners, under a wide range of conditions. Furthermore, even with recent techniques, obtaining as much information as possible from a limited number of samples still remains challenging. In this study, to tackle these challenges and to boost the discriminative power of offline signature verification, a new method using KAZE features based on the recent Fisher vector (FV) encoding is proposed. The adoption of a probabilistic visual vocabulary and higher-order statistics, both of which can encode detailed information about the distribution of KAZE features, provides us with a more precise spatial distribution of the characteristics for a writer. The experimental results on the public MCYT-75 dataset can be summarized as follows: 1) The proposed method improves performance compared to the recent vector of locally aggregated descriptors (VLAD)-based approach. 2) The use of principal component analysis (PCA)for the original FV can provide a more dimensionally compact vector without a significant loss in performance. 3) The proposed method provides much lower error rates than existing state-of-the-art offline signature verification systems when applied to the MCYT-75 dataset.

[1]  Andrew Beng Jin Teoh,et al.  Image-based handwritten signature verification using hybrid methods of discrete Radon transform, principal component analysis and probabilistic neural network , 2016, Appl. Soft Comput..

[2]  Thomas Mensink,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[3]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[4]  Manabu Okawa,et al.  OŒine writer veriˆcation based on forensic expertise: Analyzing multiple characters by combining the shape and advanced pen pressure information , 2017 .

[5]  Adrien Bartoli,et al.  KAZE Features , 2012, ECCV.

[6]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Babak Nadjar Araabi,et al.  Deep Multitask Metric Learning for Offline Signature Verification , 2016, Pattern Recognit. Lett..

[8]  Michael J. Allen,et al.  Foundations of Forensic Document Analysis: Theory and Practice , 2015 .

[9]  Ying Wen,et al.  Text-independent writer identification using SIFT descriptor and contour-directional feature , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[10]  Jesús Francisco Vargas-Bonilla,et al.  Off-line signature verification based on grey level information using texture features , 2011, Pattern Recognit..

[11]  Manabu Okawa,et al.  User generic model for writer verification using multiband image scanner , 2013, 2013 IEEE International Conference on Technologies for Homeland Security (HST).

[12]  Manabu Okawa,et al.  Text and User Generic Model for Writer Verification Using Combined Pen Pressure Information From Ink Intensity and Indented Writing on Paper , 2015, IEEE Transactions on Human-Machine Systems.

[13]  Harish Srinivasan,et al.  On the Discriminability of the Handwriting of Twins , 2008, Journal of forensic sciences.

[14]  Manabu Okawa,et al.  Off-Line Writer Verification Using Shape and Pen Pressure Information , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.

[15]  Manabu Okawa,et al.  Vector of locally aggregated descriptors with KAZE features for offline signature verification , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[16]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Loris Nanni,et al.  An On-Line Signature Verification System Based on Fusion of Local and Global Information , 2005, AVBPA.

[18]  Tieniu Tan,et al.  Feature Coding in Image Classification: A Comprehensive Study , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Sung-Hyuk Cha,et al.  Individuality of handwriting. , 2002, Journal of forensic sciences.

[20]  Julian Fiérrez,et al.  An Off-line Signature Verification System Based on Fusion of Local and Global Information , 2004, ECCV Workshop BioAW.

[21]  Qi Tian,et al.  A survey of recent advances in visual feature detection , 2015, Neurocomputing.

[22]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[23]  Gerhard P. Hancke,et al.  Unimodal and Multimodal Biometric Sensing Systems: A Review , 2016, IEEE Access.

[24]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[25]  Arun Ross,et al.  50 years of biometric research: Accomplishments, challenges, and opportunities , 2016, Pattern Recognit. Lett..

[26]  Marcus Liwicki,et al.  Man vs. Machine: A comparative analysis for Signature Verification , 2014 .

[27]  Manabu Okawa,et al.  Offline Signature Verification Based on Bag-of-VisualWords Model Using KAZE Features and Weighting Schemes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[28]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[29]  Andrew Zisserman,et al.  The devil is in the details: an evaluation of recent feature encoding methods , 2011, BMVC.

[30]  Woo Chaw Seng,et al.  A review of biometric technology along with trends and prospects , 2014, Pattern Recognit..

[31]  Giuseppe Pirlo,et al.  Automatic Signature Verification: The State of the Art , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[32]  Juan J. Igarza,et al.  MCYT baseline corpus: a bimodal biometric database , 2003 .

[33]  Julian Fierrez,et al.  Off-line Signature Verification Using Contour Features , 2008, ICFHR 2008.

[34]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Manabu Okawa,et al.  Offline writer verification using pen pressure information from infrared image , 2013, IET Biom..

[36]  Sargur N. Srihari,et al.  Role of automation in the examination of handwritten items , 2014, Pattern Recognit..