Devanagari Handwritten Character Recognition using fine-tuned Deep Convolutional Neural Network on trivial dataset

In order to rapidly build an automatic and precise system for image recognition and categorization, deep learning is a vital technology. Handwritten character classification also gaining more attention due to its major contribution in automation and specially to develop applications for helping visually impaired people. Here, the proposed work highlighting on fine-tuning approach and analysis of state-of-the-art Deep Convolutional Neural Network (DCNN) designed for Devanagari Handwritten characters classification. A new Devanagari handwritten characters dataset is generated which is publicly available. Datasets consist of total 5800 isolated images of 58 unique character classes: 12 vowels, 36 consonants and 10 numerals. In addition to this database, a two-stage VGG16 deep learning model is implemented to recognize those characters using two advanced adaptive gradient methods. A two-stage approach of deep learning is developed to enhance overall success of the proposed Devanagari Handwritten Character Recognition System (DHCRS). The first model achieves 94.84% testing accuracy with training loss of 0.18 on new dataset. Moreover, the second fine-tuned model requires very fewer trainable parameters and notably less training time to achieve state-of-the-art performance on a very small dataset. It achieves 96.55% testing accuracy with training loss of 0.12. We also tested the proposed model on four different benchmark datasets of isolated characters as well as digits of Indic scripts. For all the datasets tested, we achieved the promising results.

[1]  Sandhya Aneja,et al.  Transfer Learning using CNN for Handwritten Devanagari Character Recognition , 2019, 2019 1st International Conference on Advances in Information Technology (ICAIT).

[2]  The Anh Pham,et al.  Offline handwritten signature verification using local and global features , 2014, Annals of Mathematics and Artificial Intelligence.

[3]  Josephine Sullivan,et al.  Apprenticeship Learning: Transfer of Knowledge via Dataset Augmentation , 2013, SCIA.

[4]  Mahantapas Kundu,et al.  A multi-scale deep quad tree based feature extraction method for the recognition of isolated handwritten characters of popular indic scripts , 2017, Pattern Recognit..

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Subhadip Basu,et al.  A novel framework for automatic sorting of postal documents with multi-script address blocks , 2010, Pattern Recognit..

[8]  Mahantapas Kundu,et al.  Multiobjective optimization for recognition of isolated handwritten Indic scripts , 2019, Pattern Recognit. Lett..

[9]  Honglak Lee,et al.  Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations , 2009, ICML '09.

[10]  A. Mukerjee,et al.  Handwritten Hindi Numerals Recognition System , 2012 .

[11]  Shailesh Acharya,et al.  Deep learning based large scale handwritten Devanagari character recognition , 2015, 2015 9th International Conference on Software, Knowledge, Information Management and Applications (SKIMA).

[12]  Nibaran Das,et al.  Improved word-level handwritten Indic script identification by integrating small convolutional neural networks , 2019, Neural Computing and Applications.

[13]  Subhadip Basu,et al.  An Axiomatic Fuzzy Set Theory Based Feature Selection Methodology for Handwritten Numeral Recognition , 2014 .

[14]  Mahantapas Kundu,et al.  A statistical-topological feature combination for recognition of handwritten numerals , 2012, Appl. Soft Comput..

[15]  Amar Gupta,et al.  A system for processing handwritten bank checks automatically , 2008, Image Vis. Comput..

[16]  Rahat Hossain Faisal,et al.  Bangla Handwritten Character Recognition Using Local Binary Pattern and Its Variants , 2018, 2018 International Conference on Innovations in Science, Engineering and Technology (ICISET).

[17]  Li Yujian,et al.  A comparative study of fine-tuning deep learning models for plant disease identification , 2019, Comput. Electron. Agric..

[18]  M. B. Emeneau India as a Lingustic Area , 1956 .

[19]  Tasnuva Hassan,et al.  Handwritten Bangla numeral recognition using Local Binary Pattern , 2015, 2015 International Conference on Electrical Engineering and Information Communication Technology (ICEEICT).

[20]  A. Pravin,et al.  Ensembling: Model of histogram of oriented gradient based handwritten devanagari character recognition system , 2017, Traitement du Signal.

[21]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[22]  Md Saiful Islam,et al.  Bengali handwritten character recognition using deep convolutional neural network , 2017, 2017 20th International Conference of Computer and Information Technology (ICCIT).

[23]  M. Lowe Empires of the Word: A Language History of the World. , 2008 .

[24]  Swagatam Das,et al.  Artificial Intelligence and Evolutionary Computations in Engineering Systems , 2016 .

[25]  Wright-Patterson Afb,et al.  Feature Selection Using a Multilayer Perceptron , 1990 .

[26]  Ching Y. Suen,et al.  A novel hybrid CNN-SVM classifier for recognizing handwritten digits , 2012, Pattern Recognit..

[27]  Vijayan K. Asari,et al.  Handwritten Bangla Character Recognition Using the State-of-the-Art Deep Convolutional Neural Networks , 2017, Comput. Intell. Neurosci..

[28]  Bidyut Baran Chaudhuri,et al.  A system for Indian postal automation , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[29]  R. Vijaya Kumar Reddy,et al.  Handwritten Hindi Character Recognition using Deep Learning Techniques , 2019, International Journal of Computer Sciences and Engineering.

[30]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[31]  Yurong Liu,et al.  A survey of deep neural network architectures and their applications , 2017, Neurocomputing.

[32]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[33]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[34]  Sri. Yugandhar Manchala,et al.  Handwritten Text Recognition using Deep Learning with TensorFlow , 2020, International Journal of Engineering Research and.

[35]  Jian-Bo Yang,et al.  Feature Selection for MLP Neural Network: The Use of Random Permutation of Probabilistic Outputs , 2009, IEEE Transactions on Neural Networks.

[36]  Hitoshi Kiya,et al.  Integrated Model of Image Protection Techniques , 2018, J. Imaging.

[37]  Mita Nasipuri,et al.  Offline Script Identification from multilingual Indic-script documents: A state-of-the-art , 2015, Comput. Sci. Rev..

[38]  Khaled S. Younis,et al.  Arabic Hand-Written Character Recognition Based on Deep Convolutional Neural Networks , 2017 .

[39]  Ching Y. Suen,et al.  A trainable feature extractor for handwritten digit recognition , 2007, Pattern Recognit..

[40]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[41]  Vishal Passricha,et al.  A comparative analysis of pooling strategies for convolutional neural network based Hindi ASR , 2020, J. Ambient Intell. Humaniz. Comput..

[42]  Malayappan Shridhar,et al.  On Recognition of Handwritten Bangla Characters , 2006, ICVGIP.

[43]  Enrique Vidal,et al.  Handwritten Text Recognition for Historical Documents , 2011 .

[44]  Mahantapas Kundu,et al.  DevNet: An Efficient CNN Architecture for Handwritten Devanagari Character Recognition , 2020, Int. J. Pattern Recognit. Artif. Intell..

[45]  Khaled S. Younis,et al.  Arabic Hand-Written Character Recognition Based on Deep Convolutional Neural Networks , 2017 .

[46]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[47]  Pinaki Saha,et al.  Handwriting Recognition Using Active Contour , 2020 .

[48]  M. M. Hafizur Rahman,et al.  Bangla Handwritten Character Recognition using Convolutional Neural Network , 2015 .

[49]  Bidyut Baran Chaudhuri,et al.  Indian script character recognition: a survey , 2004, Pattern Recognit..

[50]  Bidyut Baran Chaudhuri,et al.  Automatic Detection of Handwritten Texts from Video Frames of Lectures , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[51]  Sumit Srivastava,et al.  Handwritten Devanagari Character Recognition Using Layer-Wise Training of Deep Convolutional Neural Networks and Adaptive Gradient Methods , 2018, J. Imaging.

[52]  Subhadip Basu,et al.  CMATERdb1: a database of unconstrained handwritten Bangla and Bangla–English mixed script document image , 2011, International Journal on Document Analysis and Recognition (IJDAR).