Fusion of HMM Classifiers, Based on x, y and (x, y) Signals, for the Recognition of Online Farsi Handwriting: a Large Lexicon Approach

Online handwriting is basically formed by a combination of horizontal and vertical trajectories. We employed decision fusion of semi-continuous hidden Markov model (HMM), classifiers, designed for x, y and (x, y) signals separately, to increase the recognition rate of online Farsi subwords. Because of large lexicon and few training samples for some classes, an embedded method was used to train HMM models of subwords. The result of segmentation of (x, y) signal was exploited to segment x and y signals to letters or sub-letters in the training phase. Different decision fusions of the three classifiers were investigated. The best result was achieved by applying the product rule to combine y and (x, y) classifiers.

[1]  Karim Faez,et al.  Handwritten Farsi (Arabic) word recognition: a holistic approach using discrete HMM , 2001, Pattern Recognit..

[2]  Off-line recognition of handwritten middle age Persian characters using moment , 2006, Pattern Recognition and Image Analysis.

[3]  Marcus Liwicki,et al.  Feature Selection for HMM and BLSTM Based Handwriting Recognition of Whiteboard Notes , 2009, Int. J. Pattern Recognit. Artif. Intell..

[4]  Chafic Mokbel,et al.  Combining Slanted-Frame Classifiers for Improved HMM-Based Arabic Handwriting Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Michel Gilloux Hidden Markov Models in Handwriting Recognition , 1994 .

[6]  Horst Bunke,et al.  Recognition of cursive Roman handwriting: past, present and future , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[7]  Ehsanollah Kabir,et al.  A blackboard approach towards integrated Farsi OCR system , 2009, International Journal of Document Analysis and Recognition (IJDAR).

[8]  S. Eddy Hidden Markov models. , 1996, Current opinion in structural biology.

[9]  Chafic Mokbel,et al.  Dynamic and Contextual Information in HMM Modeling for Handwritten Word Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Masaki Nakagawa,et al.  The state of the art in Japanese online handwriting recognition compared to techniques in western handwriting recognition , 2003, Document Analysis and Recognition.

[11]  Volker Märgner,et al.  On-line Arabic handwriting recognition competition , 2010, International Journal on Document Analysis and Recognition (IJDAR).

[12]  Mario Vento,et al.  Image Analysis and Processing - ICIAP 2009, 15th International Conference Vietri sul Mare, Italy, September 8-11, 2009, Proceedings , 2009, ICIAP.

[13]  Ling Guan,et al.  Velocity and pressure-based partitions of horizontal and vertical trajectories for on-line signature verification , 2010, Pattern Recognit..

[14]  Ehsanollah Kabir,et al.  Introducing a very large dataset of handwritten Farsi digits and a study on their varieties , 2007, Pattern Recognit. Lett..

[15]  Saeed Bagheri Shouraki,et al.  Recognition of Persian Online Handwriting Using Elastic Fuzzy Pattern Recognition , 2007, Int. J. Pattern Recognit. Artif. Intell..

[16]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[17]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[18]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[19]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Saeed Bagheri Shouraki,et al.  A novel fuzzy approach to recognition of online Persian handwriting , 2005, 5th International Conference on Intelligent Systems Design and Applications (ISDA'05).

[21]  Jonas Andersson,et al.  On-line Arabic handwriting recognition with templates , 2009, Pattern Recognit..

[22]  Masaki Nakagawa,et al.  'Online recognition of Chinese characters: the state-of-the-art , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Ching Y. Suen,et al.  A New Large-Scale Multi-purpose Handwritten Farsi Database , 2009, ICIAR.

[24]  Anil K. Jain,et al.  Online handwritten script recognition , 2004 .

[25]  Steve Young,et al.  The HTK book , 1995 .

[26]  Saudi Arabia,et al.  RECOGNITION OF OFF-LINE HANDWRITTEN ARABIC (INDIAN) NUMERALS USING MULTI-SCALE FEATURES AND SUPPORT VECTOR MACHINES VS. HIDDEN MARKOV MODELS , 2009 .

[27]  Saeed Mozaffari,et al.  Lexicon reduction using dots for off-line Farsi/Arabic handwritten word recognition , 2008, Pattern Recognit. Lett..

[28]  Ehsanollah Kabir,et al.  Feature Extraction for Online Farsi Characters , 2010, 2010 12th International Conference on Frontiers in Handwriting Recognition.

[29]  Ehsanollah Kabir,et al.  Lexicon Reduction Using Delayed Strokes for the Recognition of Online Farsi Subwords , 2011 .

[30]  Ehud Rivlin,et al.  Offline cursive script word recognition – a survey , 1999, International Journal on Document Analysis and Recognition.

[31]  Venu Govindaraju,et al.  Offline Arabic handwriting recognition: a survey , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  E Kabir,et al.  A SIMPLE METHOD FOR ONLINE RECOGNITION OF FARSI SUBWORDS , 2005 .

[33]  Josef Kittler,et al.  Modified product fusion , 2002, Pattern Recognit. Lett..

[34]  D. Ruta,et al.  An Overview of Classifier Fusion Methods , 2000 .

[35]  Alexander H. Waibel,et al.  Online handwriting recognition: the NPen++ recognizer , 2001, International Journal on Document Analysis and Recognition.

[36]  Marcus Liwicki,et al.  HMM-Based On-Line Recognition of Handwritten Whiteboard Notes , 2006 .