Automatic Signature Segmentation Using Hyper-Spectral Imaging

In this paper, we propose a method for automatic signature segmentation using hyper-spectral imaging. The proposed method first uses the connected component analysis and local features to segment the printed text and signatures. Secondly, it uses spectral response of text, signature, and background to extract signature pixels. The proposed method is robust, and remains unaffected by color and intensity of the ink, and by any structural information of the text, as the classification relies exclusively on the spectral response of the document. The proposed method can extract signature pixels either overlapping or non-overlapping from different backgrounds like, logos, tables, stamps, and printed text. We used high-resolution hyper-spectral imaging to study and classify 300 documents with varying backgrounds. We evaluated the proposed classification method and compared results with the state-of-the art system. The proposed method outperformed the state-of-the-art system and achieved 100% precision and 84% recall.

[1]  Hyung Il Koo,et al.  Scene Text Detection via Connected Component Clustering and Nontext Filtering , 2013, IEEE Transactions on Image Processing.

[2]  G. de Bruin,et al.  QUANTITATIVE HYPERSPECTRAL IMAGING OF HISTORICAL DOCUMENTS: TECHNIQUE AND APPLICATIONS , 2008 .

[3]  David S. Doermann,et al.  Multi-scale Structural Saliency for Signature Detection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Ajmal S. Mian,et al.  Bayesian sparse representation for hyperspectral image super resolution , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Mongi A. Abidi,et al.  Hyperspectral Face Databases for Facial Recognition Research , 2016, Face Recognition Across the Imaging Spectrum.

[6]  Robert W. G. Hunt,et al.  The reproduction of colour , 1957 .

[7]  Maria Fernanda Pimentel,et al.  Near infrared hyperspectral imaging for forensic analysis of document forgery. , 2014, The Analyst.

[8]  Réjean Plamondon,et al.  Automatic Signature Verification: The State of the Art - 1989-1993 , 1994, Int. J. Pattern Recognit. Artif. Intell..

[9]  Dan Savastru,et al.  Hyperspectral Imaging in the Medical Field: Present and Future , 2014 .

[10]  Michael Fairhurst,et al.  Signature verification revisited: promoting practical exploitation of biometric technology , 1997 .

[11]  Ayan Chakrabarti,et al.  Statistics of real-world hyperspectral images , 2011, CVPR 2011.

[12]  William A. Barrett,et al.  Connected Component Level Discrimination of Handwritten and Machine-Printed Text Using Eigenfaces , 2011, 2011 International Conference on Document Analysis and Recognition.

[13]  Roger L. Easton,et al.  Multispectral imaging of the Archimedes palimpsest , 2003, 32nd Applied Imagery Pattern Recognition Workshop, 2003. Proceedings..

[14]  I. E. Ruyter,et al.  Color stability of dental composite resin materials for crown and bridge veneers. , 1987, Dental materials : official publication of the Academy of Dental Materials.

[15]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Yi Li,et al.  Script-Independent Text Line Segmentation in Freestyle Handwritten Documents , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Michael S. Brown,et al.  Visual enhancement of old documents with hyperspectral imaging , 2011, Pattern Recognit..

[19]  Robert Sablatnig,et al.  Spatial and Spectral Based Segmentation of Text in Multispectral Images of Ancient Documents , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[20]  E MARVIN,et al.  Clearing the Image: A Quantitative Analysis of Historical Documents Using Hyperspectral Measurements , 2010 .

[21]  K. Savage,et al.  Hyperspectral imaging of gel pen inks: an emerging tool in document analysis. , 2014, Science & justice : journal of the Forensic Science Society.

[22]  Michael Fairhurst,et al.  Perceptual Analysis of Handwritten Signatures for Biometric Authentication , 2003 .

[23]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[24]  Ajmal S. Mian,et al.  Futuristic Greedy Approach to Sparse Unmixing of Hyperspectral Data , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Umapada Pal,et al.  Signature Segmentation from Machine Printed Documents Using Conditional Random Field , 2011, 2011 International Conference on Document Analysis and Recognition.

[26]  Marcus Liwicki,et al.  Comparative Study of Part-Based Handwritten Character Recognition Methods , 2011, 2011 International Conference on Document Analysis and Recognition.

[27]  J. Blasco,et al.  Recent Advances and Applications of Hyperspectral Imaging for Fruit and Vegetable Quality Assessment , 2012, Food and Bioprocess Technology.

[28]  Marcus Liwicki,et al.  Hyper-spectral Analysis for Automatic Signature Extraction , 2015 .

[29]  Pierre Vandergheynst,et al.  Hyperspectral image compressed sensing via low-rank and joint-sparse matrix recovery , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[30]  Chein-I. Chang.  Hyperspectral Imaging: Techniques for Spectral Detection and Classification , 2003 .

[31]  Ajmal S. Mian,et al.  Joint Group Sparse PCA for Compressed Hyperspectral Imaging , 2015, IEEE Transactions on Image Processing.

[32]  Richard J. Murphy,et al.  Evaluating the performance of a new classifier – the GP-OAD: A comparison with existing methods for classifying rock type and mineralogy from hyperspectral imagery , 2014 .

[33]  Malte Rehbein,et al.  The Ghost in the Manuscript: Hyperspectral Text Recovery and Segmentation , 2009 .

[34]  Bryan Found,et al.  Forensic handwriting examiners' expertise for signature comparison. , 2002, Journal of forensic sciences.

[35]  Ajmal S. Mian,et al.  Hyperspectral Imaging for Ink Mismatch Detection , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[36]  Ajmal S. Mian,et al.  Towards Automated Hyperspectral Document Image Analysis , 2013, AFHA.