Analysis and comparison of machine learning classifiers and deep neural networks techniques for recognition of Farsi handwritten digits

Handwriting recognition remains a challenge in the machine vision field, especially in optical character recognition (OCR). The OCR has various applications such as the detection of handwritten Farsi digits and the diagnosis of biomedical science. In expanding and improving quality of the subject, this research focus on the recognition of Farsi Handwriting Digits and illustration applications in biomedical science. The detection of handwritten Farsi digits is being widely used in most contexts involving the collection of generic digital numerical information, such as reading checks or digits of postcodes. Selecting an appropriate classifier has become an issue highlighted in the recognition of handwritten digits. The paper aims at identifying handwritten Farsi digits written with different handwritten styles. Digits are classified using several traditional methods, including K-nearest neighbor, artificial neural network (ANN), and support vector machine (SVM) classifiers. New features of digits, namely, geometric and correlation-based features, have demonstrated to achieve better recognition performance. A noble class of methods, known as deep neural networks (DNNs), is also used to identify handwritten digits through machine vision. Here, two types of introduce its expansion form, a convolutional neural network (CNN) and an auto-encoder, are implemented. Moreover, by using a new combination of CNN layers one can obtain improved results in classifying Farsi digits. The performances of the DNN-based and traditional classifiers are compared to investigate the improvements in accuracy and calculation time. The SVM shows the best results among the traditional classifiers, whereas the CNN achieves the best results among the investigated techniques. The ANN offers better execution time than the SVM, but its accuracy is lower. The best accuracy among the traditional classifiers based on all investigated features is 99.3% accuracy obtained by the SVM, and the CNN achieves the best overall accuracy of 99.45%.

[1]  Wenling Wu,et al.  New algorithms for the unbalanced generalised birthday problem , 2018, IET Inf. Secur..

[2]  Guolong Chen,et al.  A PSO-based timing-driven Octilinear Steiner tree algorithm for VLSI routing considering bend reduction , 2015, Soft Comput..

[3]  Mutlu Avci,et al.  Performance comparison of different momentum techniques on deep reinforcement learning* , 2017, J. Inf. Telecommun..

[4]  Abdul Kawsar Tushar,et al.  Handwritten Arabic numeral recognition using deep learning neural networks , 2017, 2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR).

[5]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[6]  Farhana Sultana,et al.  BDNet: Bengali handwritten numeral digit recognition based on densely connected convolutional neural networks , 2019, J. King Saud Univ. Comput. Inf. Sci..

[7]  Yuzhen Niu,et al.  Fast Gaussian kernel learning for classification tasks based on specially structured global optimization , 2014, Neural Networks.

[8]  João Rogério Caldas Pinto,et al.  Hybrid neural models for automatic handwritten digits recognition , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[9]  Ali Broumandnia,et al.  Persian Handwritten Word Recognition Using Zernike and Fourier-Mellin Moments , 2009 .

[10]  Ching Y. Suen,et al.  A novel cascade ensemble classifier system with a high recognition performance on handwritten digits , 2007, Pattern Recognit..

[11]  Vahid Ghods,et al.  Farsi Handwriting Digit Recognition Based on Convolutional Neural Networks , 2018, 2018 6th International Symposium on Computational and Business Intelligence (ISCBI).

[12]  Wenzhong Guo,et al.  A unified algorithm based on HTS and self-adapting PSO for the construction of octagonal and rectilinear SMT , 2019, Soft Computing.

[13]  Kwai-Sang Chin,et al.  Multi-attribute search framework for optimizing extended belief rule-based systems , 2016, Inf. Sci..

[14]  Mojtaba Mohammadpoor,et al.  A Novel Method for Persian Handwritten Digit Recognition Using Support Vector Machine , 2018 .

[15]  Karim Faez,et al.  Feature extraction with wavelet transform for recognition of isolated handwritten Farsi/Arabic characters and numerals , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[16]  Varsha Sahni,et al.  Region growing segmentation using de-noising algorithm for medical ultrasound images , 2017, 2017 3rd International Conference on Computational Intelligence & Communication Technology (CICT).

[17]  Alireza Alaei,et al.  Using Modified Contour Features and SVM Based Classifier for the Recognition of Persian/Arabic Handwritten Numerals , 2009, 2009 Seventh International Conference on Advances in Pattern Recognition.

[18]  Jaafar Alghazo,et al.  Multi-Language Handwritten Digits Recognition based on Novel Structural Features , 2019, Journal of Imaging Science and Technology.

[19]  Jun Wang,et al.  A Complex-Valued Projection Neural Network for Constrained Optimization of Real Functions in Complex Variables , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[20]  Davar Giveki,et al.  Farsi/Arabic handwritten digit recognition based on ensemble of SVD classifiers and reliable multi-phase PSO combination rule , 2012, International Journal on Document Analysis and Recognition (IJDAR).

[21]  Mohammad Rahmati,et al.  Recognition of Persian handwritten digits using image profiles of multiple orientations , 2004, Pattern Recognit. Lett..

[22]  M RajeshKumar,et al.  Handwritten Character Recognition Using Unique Feature Extraction Technique , 2018, 2018 3rd IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT).

[23]  Serkan Günal,et al.  The impact of preprocessing on text classification , 2014, Inf. Process. Manag..

[24]  Mohammad Mosleh,et al.  Persian Handwritten Digit Recognition Using Ensemble Classifiers , 2015 .

[25]  Fuad Rahman,et al.  Sankhya: An Unbiased Benchmark for Bangla Handwritten Digits Recognition , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[26]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[27]  Yang Yang Broadcast encryption based non-interactive key distribution in MANETs , 2014, J. Comput. Syst. Sci..

[28]  Saraju P. Mohanty,et al.  FuzzRoute: A Thermally Efficient Congestion-Free Global Routing Method for Three-Dimensional Integrated Circuits , 2015, ACM Trans. Design Autom. Electr. Syst..

[29]  Guolong Chen,et al.  Trust dynamic task allocation algorithm with Nash equilibrium for heterogeneous wireless sensor network , 2015, Secur. Commun. Networks.

[30]  Zaid Omar,et al.  A review of hand gesture and sign language recognition techniques , 2017, International Journal of Machine Learning and Cybernetics.

[31]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[32]  Guolong Chen,et al.  MLXR: multi-layer obstacle-avoiding X-architecture Steiner tree construction for VLSI routing , 2015, Science China Information Sciences.

[33]  Jun Wang,et al.  Low-dimensional recurrent neural network-based Kalman filter for speech enhancement , 2015, Neural Networks.

[34]  Reza Ebrahimpour,et al.  Handwritten Farsi Word Recognition Using NN-Based Fusion of HMM Classifiers with Different Types of Features , 2019, Int. J. Image Graph..

[35]  Hammad A. Qureshi,et al.  High Quality Wavelets Features Extraction for Handwritten Arabic Numerals Recognition , 2019, International Journal on Advanced Science, Engineering and Information Technology.

[36]  Henry Leung,et al.  Performance analysis of statistical optimal data fusion algorithms , 2014, Inf. Sci..

[37]  Juan Humberto Sossa Azuela,et al.  A Convolutional Neural Network for Handwritten Digit Recognition , 2020, Int. J. Comb. Optim. Probl. Informatics.

[38]  Jia Wang,et al.  Event-triggered dissipative control for networked stochastic systems under non-uniform sampling , 2018, Inf. Sci..

[39]  Parag S. Deshpande,et al.  Review of Feature Extraction Techniques for Character Recognition , 2018 .

[40]  Guolong Chen,et al.  XGRouter: high-quality global router in X-architecture with particle swarm optimization , 2015, Frontiers of Computer Science.

[41]  Abdelhak Boukharouba,et al.  Novel feature extraction technique for the recognition of handwritten digits , 2017 .

[42]  Stavros J. Perantonis,et al.  Handwritten character recognition through two-stage foreground sub-sampling , 2010, Pattern Recognit..

[43]  Rui Guo,et al.  A Twin Multi-Class Classification Support Vector Machine , 2012, Cognitive Computation.

[44]  Amir H. Gandomi,et al.  Assistive pointer device for limb impaired people: A novel Frontier Point Method for hand movement recognition , 2019, Future Gener. Comput. Syst..

[45]  Ali Borji,et al.  Invariance analysis of modified C2 features: case study—handwritten digit recognition , 2009, Machine Vision and Applications.

[46]  Guolong Chen,et al.  FH-OAOS , 2016, ACM Trans. Design Autom. Electr. Syst..

[47]  Wei Xing Zheng,et al.  A complex-valued neural dynamical optimization approach and its stability analysis , 2015, Neural Networks.

[48]  Ehsanollah Kabir,et al.  Introducing a very large dataset of handwritten Farsi digits and a study on their varieties , 2007, Pattern Recognit. Lett..

[49]  Alireza Alaei,et al.  Fine Classification of Unconstrained Handwritten Persian/Arabic Numerals by Removing Confusion amongst Similar Classes , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[50]  SchmidhuberJürgen Deep learning in neural networks , 2015 .

[51]  Laurene V. Fausett,et al.  Fundamentals Of Neural Networks , 1994 .

[52]  Qishan Zhang,et al.  Community discovery by propagating local and global information based on the MapReduce model , 2015, Inf. Sci..

[53]  M. Montaz Ali,et al.  Max-k-Cut by the Discrete Dynamic Convexized Method , 2013, INFORMS J. Comput..

[54]  Vandana,et al.  Survey of Nearest Neighbor Techniques , 2010, ArXiv.

[55]  D. Swapna,et al.  An Efficient Digit Recognition System with an Improved Preprocessing Technique , 2019, ICICCT - 2019.