Neural Architecture based on Fuzzy Perceptual Representation For Online Multilingual Handwriting Recognition

Due to the omnipresence of mobile devices, online handwritten scripts have become the most important feeding input to smartphones and tablet devices. To increase online handwriting recognition performance, deeper neural networks have extensively been used. In this context, our paper handles the problem of online handwritten script recognition based on extraction features system and deep approach system for sequences classification. Many solutions have appeared in order to facilitate the recognition of handwriting. Accordingly, we used an existent method and combined with new classifiers in order to get a flexible system. Good results are achieved compared to online characters and words recognition system on Latin and Arabic scripts. The performance of our two proposed systems is assessed by using five databases. Indeed, the recognition rate exceeds 98%.

[1]  Stefan Knerr,et al.  The IRESTE On/Off (IRONOFF) dual handwriting database , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[2]  Hermann Ney,et al.  Framewise and CTC training of Neural Networks for handwriting recognition , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[3]  Adel M. Alimi,et al.  A New Encoding System: Application to On-line Arabic Handwriting , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[4]  Lianwen Jin,et al.  Improved deep convolutional neural network for online handwritten Chinese character recognition using domain-specific knowledge , 2015, 2015 13th International Conference on Document Analysis and Recognition (ICDAR).

[5]  Lianwen Jin,et al.  Design of a Very Compact CNN Classifier for Online Handwritten Chinese Character Recognition Using DropWeight and Global Pooling , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[6]  Jun Du,et al.  A GRU-Based Encoder-Decoder Approach with Attention for Online Handwritten Mathematical Expression Recognition , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[7]  Adel M. Alimi,et al.  A Hybrid NN/HMM Modeling Technique for Online Arabic Handwriting Recognition , 2014, ArXiv.

[8]  Ching Y. Suen,et al.  The State of the Art in Online Handwriting Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yoshua Bengio,et al.  Drawing and Recognizing Chinese Characters with Recurrent Neural Network , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Adel M. Alimi,et al.  A Spiking Neural Network Model with Fuzzy Learning Rate Application for Complex Handwriting Movements Generation , 2016, HIS.

[11]  Adel M. Alimi,et al.  An Online Writer Identification System based on Beta-Elliptic Model and Fuzzy Elementary Perceptual Codes , 2018, ArXiv.

[12]  Victor Carbune,et al.  Fast multi-language LSTM-based online handwriting recognition , 2020, International Journal on Document Analysis and Recognition (IJDAR).

[13]  Monji Kherallah,et al.  Recognizing online Arabic handwritten characters using a deep architecture , 2017, International Conference on Machine Vision.

[14]  Gerhard Rigoll,et al.  Novel Hybrid NN/HMM Modelling Techniques for On-line Handwriting Recognition , 2006 .

[15]  Victor Carbune,et al.  Multi-Language Online Handwriting Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Adel M. Alimi,et al.  Online Arabic handwriting recognition: a survey , 2013, International Journal on Document Analysis and Recognition (IJDAR).

[17]  Adel M. Alimi,et al.  Decision trees based on perceptual codes for on-line Arabic character recognition , 2017, 2017 1st International Workshop on Arabic Script Analysis and Recognition (ASAR).

[18]  Adel M. Alimi,et al.  A fuzzy genetic system for segmentation of on-line handwriting: Application to ADAB database , 2011, 2011 IEEE 5th International Workshop on Genetic and Evolutionary Fuzzy Systems (GEFS).

[19]  Alexander H. Waibel,et al.  Online handwriting recognition: the NPen++ recognizer , 2001, International Journal on Document Analysis and Recognition.

[21]  José Ruiz Pinales.  Reconnaissance hors-ligne de l'écriture cursive par l'utilisation de modèles perceptifs et neuronaux , 2001 .

[22]  Nabil Derbel,et al.  A developmental theory of the relation between geometry and kinematics in handwriting , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[23]  Guohua Ren,et al.  Recognition of Online Handwriting with Variability on Smart Devices , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Adel M. Alimi,et al.  Android application for handwriting segmentation using PerTOHS theory , 2017, International Conference on Machine Vision.

[25]  N. Derbel,et al.  Recognition of on-line handwritten digits by neural networks using circular and beta approaches , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[26]  Venu Govindaraju,et al.  Offline Arabic handwriting recognition: a survey , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Adel M. Alimi,et al.  Genetic Algorithms for Perceptual Codes Extraction , 2012 .

[28]  Hala Bezine,et al.  On-line arabic handwriting segmentation via perceptual codes: application to MAYASTROUN database , 2011, Eighth International Multi-Conference on Systems, Signals & Devices.

[29]  Volker Märgner,et al.  On-line Arabic handwriting recognition competition , 2010, International Journal on Document Analysis and Recognition (IJDAR).

[30]  Adel M. Alimi,et al.  Off-lexicon online Arabic handwriting recognition using neural network , 2017, International Conference on Machine Vision.

[31]  Endang Setyati,et al.  Real time handwriting recognition for mathematic expressions using Hidden Markov Model , 2016, 2016 International Seminar on Intelligent Technology and Its Applications (ISITIA).

[32]  Jürgen Schmidhuber,et al.  Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks , 2006, ICML.

[33]  Raul Camposano,et al.  A Fuzzy Online Handwriting REcognition System : FOHRES , 1993 .

[34]  Vahid Ghods,et al.  Online Farsi Handwritten Character Recognition Using Hidden Markov Model , 2016, J. Comput..

[35]  The On/Off (LMCA) Dual Arabic Handwriting Database , 2008 .

[36]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[37]  Adel M. Alimi,et al.  Online Arabic writer identification based on Beta-elliptic model , 2015, 2015 15th International Conference on Intelligent Systems Design and Applications (ISDA).

[38]  Adel M. Alimi,et al.  MAYASTROUN: A Multilanguage Handwriting Database , 2012, 2012 International Conference on Frontiers in Handwriting Recognition.