Offline Signature Verification Using Online Handwriting Registration

This paper proposes a novel framework for offline signature verification. Different from previous methods, our approach makes use of online handwriting instead of handwritten images for registration. The online registrations enable robust recovery of the writing trajectory from an input offline signature and thus allow effective shape matching between registration and verification signatures. In addition, we propose several new techniques to improve the performance of the new signature verification system: 1. we formulate and solve the recovery of writing trajectory within the framework of conditional random fields; 2. we propose a new shape descriptor, online context, for aligning signatures; 3. we develop a verification criterion which combines the duration and amplitude variances of handwriting. Experiments on a benchmark database show that the proposed method significantly outperforms the well-known offline signature verification methods and achieve comparable performance with online signature verification methods.

[1]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[2]  Vishvjit S. Nalwa,et al.  Automatic On-line Signature Verification , 1997 .

[3]  Hong Chang,et al.  SVC2004: First International Signature Verification Competition , 2004, ICBA.

[4]  Yuan Qi,et al.  Diagram structure recognition by Bayesian conditional random fields , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Sukhan Lee,et al.  Offline tracing and representation of signatures , 1992, IEEE Trans. Syst. Man Cybern..

[6]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[7]  Pietro Perona,et al.  Visual Identification by Signature Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Réjean Plamondon,et al.  An evaluation of motor models of handwriting , 1989, IEEE Trans. Syst. Man Cybern..

[9]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Yu Qiao,et al.  Recover Writing Trajectory from Multiple Stroked Image Using Bidirectional Dynamic Search , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Trevor Hastie,et al.  A model for signature verification , 1991, Conference Proceedings 1991 IEEE International Conference on Systems, Man, and Cybernetics.

[12]  Ben M. Herbst,et al.  Estimating the pen trajectories of static signatures using hidden Markov models , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Sargur N. Srihari,et al.  Offline Signature Verification And Identification Using Distance Statistics , 2004, Int. J. Pattern Recognit. Artif. Intell..

[14]  Jianying Hu,et al.  A Hidden Markov Model approach to online handwritten signature verification , 1998, International Journal on Document Analysis and Recognition.

[15]  Feng Lin,et al.  Dynamic stroke information analysis for video-based handwritten Chinese character recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[16]  Alex Pentland,et al.  Probabilistic Visual Learning for Object Representation , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Feng Lin,et al.  Video-based handwritten Chinese character recognition , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Réjean Plamondon,et al.  The generation of handwriting with delta-lognormal synergies , 1998, Biological Cybernetics.

[19]  Anil K. Jain,et al.  On-line signature verification, , 2002, Pattern Recognit..

[20]  Yu Qiao,et al.  A Framework Toward Restoration of Writing Order from Single-Stroked Handwriting Image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Yuan Yan Tang,et al.  Off-line signature verification by the tracking of feature and stroke positions , 2003, Pattern Recognit..

[22]  Robert Sabourin,et al.  An extended-shadow-code based approach for off-line signature verification , 1993, Proceedings of 2nd International Conference on Document Analysis and Recognition (ICDAR '93).

[23]  J. M. Hammersley,et al.  Markov fields on finite graphs and lattices , 1971 .

[24]  J. Darroch,et al.  Generalized Iterative Scaling for Log-Linear Models , 1972 .