Exploiting Multi-Scale Fusion, Spatial Attention and Patch Interaction Techniques for Text-Independent Writer Identification

Text independent writer identification is a challenging problem that differentiates between different handwriting styles to decide the author of the handwritten text. Earlier writer identification relied on handcrafted features to reveal pieces of differences between writers. Recent work with the advent of convolutional neural network, deep learningbased methods have evolved. In this paper, three different deep learning techniques spatial attention mechanism, multi-scale feature fusion and patch-based CNN were proposed to effectively capture the difference between each writer’s handwriting. Our methods are based on the hypothesis that handwritten text images have specific spatial regions which are more unique to a writer’s style, multi-scale features propagate characteristic features with respect to individual writers and patch-based features give more general and robust representations that helps to discriminate handwriting from different writers. The proposed methods outperforms various state-of-the-art methodologies on word-level and page-level writer identification methods on three publicly available datasets CVL, Firemaker, CERUG-EN datasets and give comparable performance on the IAM dataset.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Kyoung Mu Lee,et al.  Enhanced Deep Residual Networks for Single Image Super-Resolution , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Lambert Schomaker,et al.  FragNet: Writer Identification Using Deep Fragment Networks , 2020, IEEE Transactions on Information Forensics and Security.

[4]  Louis Vuurpijl,et al.  Forensic writer identification: a benchmark data set and a comparison of two systems , 2000 .

[5]  Mahdi Jampour,et al.  A deep learning framework for text-independent writer identification , 2020, Eng. Appl. Artif. Intell..

[6]  Umapada Pal,et al.  MSRF-Net: A Multi-Scale Residual Fusion Network for Biomedical Image Segmentation , 2021, IEEE journal of biomedical and health informatics.

[7]  Ibrahim A. Hameed,et al.  Automatic Visual Features for Writer Identification: A Deep Learning Approach , 2019, IEEE Access.

[8]  Yang Zhao,et al.  Deep High-Resolution Representation Learning for Visual Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christian Viard-Gaudin,et al.  Automatic writer identification framework for online handwritten documents using character prototypes , 2009, Pattern Recognit..

[10]  Youbao Tang,et al.  Text-Independent Writer Identification via CNN Features and Joint Bayesian , 2016, 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR).

[11]  Lambert Schomaker,et al.  Writer identification using directional ink-trace width measurements , 2012, Pattern Recognit..

[12]  Lambert Schomaker,et al.  Text-Independent Writer Identification and Verification Using Textural and Allographic Features , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Linjie Xing,et al.  DeepWriter: A Multi-stream Deep CNN for Text-Independent Writer Identification , 2016, 2016 15th International Conference on Frontiers in Handwriting Recognition (ICFHR).

[14]  Graham Leedham,et al.  Extraction and analysis of forensic document examiner features used for writer identification , 2007, Pattern Recognit..

[15]  Robert Sablatnig,et al.  CVL-DataBase: An Off-Line Database for Writer Retrieval, Writer Identification and Word Spotting , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[16]  Zhenyu He,et al.  Writer identification of Chinese handwriting documents using hidden Markov tree model , 2008, Pattern Recognit..

[17]  Robert Sablatnig,et al.  Writer Identification and Retrieval Using a Convolutional Neural Network , 2015, CAIP.

[18]  David S. Doermann,et al.  Writer Identification Using an Alphabet of Contour Gradient Descriptors , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[19]  Yassine Ruichek,et al.  Cross multi-scale locally encoded gradient patterns for off-line text-independent writer identification , 2020, Eng. Appl. Artif. Intell..

[20]  Lambert Schomaker,et al.  Automatic writer identification using connected-component contours and edge-based features of uppercase Western script , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Robert Sablatnig,et al.  Learning Features for Writer Retrieval and Identification using Triplet CNNs , 2018, 2018 16th International Conference on Frontiers in Handwriting Recognition (ICFHR).

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  David S. Doermann,et al.  Offline Writer Identification Using K-Adjacent Segments , 2011, 2011 International Conference on Document Analysis and Recognition.

[24]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[25]  Lambert Schomaker,et al.  Junction detection in handwritten documents and its application to writer identification , 2015, Pattern Recognit..

[26]  Horst Bunke,et al.  The IAM-database: an English sentence database for offline handwriting recognition , 2002, International Journal on Document Analysis and Recognition.