Enhancing AlexNet for Arabic Handwritten words Recognition Using Incremental Dropout

Currently, the growth of mobile technologies, lead to a necessity to develop handwritten recognition applications. While the recognition of handwritten Latin and Chinese has been extensively investigated using various techniques, so little works have been done on Arabic handwritten recognition, and none of the existing techniques is accurate enough for practical application. Over the past few years, deeper convolutional neural networks (CNNs) have widely been employed for improving handwritten recognition performance. In this paper, we enhance the popular AlexNet for Arabic Handwritten Words Recognition (HWR). By adopting a dropout regularization, we prevented our system against overfitting problem and reduced the error recognition rate. We also investigated ReLU and tanH activation functions performance in the fully connected layers. Through several settings of experiments using the benchmarking IFN/ENIT Database, we achieved a new state-of-the-art classification accuracy of 92.13% and 92.55%. Lastly, we compared our best result to those of previous state-of-the-art.

[1]  Sabri A. Mahmoud,et al.  Arabic handwriting recognition using structural and syntactic pattern attributes , 2013, Pattern Recognit..

[2]  María José Castro Bleda,et al.  Holistic cursive word recognition based on perceptual features , 2007, Pattern Recognit. Lett..

[3]  Venu Govindaraju,et al.  The Role of Holistic Paradigms in Handwritten Word Recognition , 2009 .

[4]  Sargur N. Srihari,et al.  An Assessment of Arabic Handwriting Recognition Technology , 2012 .

[5]  Jürgen Schmidhuber,et al.  Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks , 2008, NIPS.

[6]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Monji Kherallah,et al.  Deep Learning for Feature Extraction of Arabic Handwritten Script , 2015, CAIP.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jun Sun,et al.  Handwritten Character Recognition by Alternately Trained Relaxation Convolutional Neural Network , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[10]  Abdurazzag Ali Aburas,et al.  Arabic handwriting recognition: Challenges and solutions , 2008, 2008 International Symposium on Information Technology.

[11]  Alessandro Vinciarelli,et al.  A survey on off-line Cursive Word Recognition , 2002, Pattern Recognit..

[12]  Xiaodong Gu,et al.  Towards dropout training for convolutional neural networks , 2015, Neural Networks.

[13]  Ching Y. Suen,et al.  Legal amount recognition based on the segmentation hypotheses for bank check processing , 2001, Proceedings of Sixth International Conference on Document Analysis and Recognition.

[14]  Chafic Mokbel,et al.  Combining Slanted-Frame Classifiers for Improved HMM-Based Arabic Handwriting Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  J. Cȏté,et al.  Understanding dropout and prolonged engagement in adolescent competitive sport , 2008 .

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  J. Schmidhuber,et al.  Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks , 2008, NIPS 2008.

[18]  Abdel Belaïd,et al.  Towards Arabic Handwritten Word Recognition via Probabilistic Graphical Models , 2014, 2014 14th International Conference on Frontiers in Handwriting Recognition.

[19]  Najoua Essoukri Ben Amara,et al.  Dynamic hierarchical Bayesian network for Arabic handwritten word recognition , 2013, Fourth International Conference on Information and Communication Technology and Accessibility (ICTA).

[20]  Peter Corcoran,et al.  Smart Augmentation Learning an Optimal Data Augmentation Strategy , 2017, IEEE Access.

[21]  Yann LeCun,et al.  Regularization of Neural Networks using DropConnect , 2013, ICML.

[22]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[23]  Yoshua Bengio,et al.  Online and offline handwritten Chinese character recognition: A comprehensive study and new benchmark , 2016, Pattern Recognit..

[24]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).