WORD LEVEL DISCRIMINATIVE TRAINING FOR HANDWRITTEN WORD RECOGNITION

Word level training refers to the process of learning the parameters of a word recognition system based on word level criteria functions. Previously, researchers trained lexicon-driven handwritten word recognition systems at the character level individually. These systems generally use statistical or neural based character recognizers to produce character level confidence scores. In the case of neural networks, the objective functions used in training involve minimizing the difference between some desired outputs and the actual outputs of the network. Desired outputs are generally not directly tied to word recognition performance. In this paper, we describe methods to optimize the parameters of these networks using word level optimization criteria. Experimental results show that word level discriminative training without desired outputs not only outperforms character level training but also eliminates the difficulty of choosing desired outputs. The method can also be applied to all segmentation based handwritten word recognition systems.

[1]  Paul D. Gader,et al.  Lexicon-Driven Handwritten Word Recognition Using Optimal Linear Combinations of Order Statistics , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Paul D. Gader,et al.  Handwritten word recognition using generalized hidden markov models , 1995 .

[3]  Venu Govindaraju,et al.  System for reading handwritten documents , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[4]  Paul D. Gader,et al.  Dynamic-programming-based handwritten word recognition using the Choquet fuzzy integral as the match function , 1996, J. Electronic Imaging.

[5]  Biing-Hwang Juang,et al.  Discriminative learning for minimum error classification [pattern recognition] , 1992, IEEE Trans. Signal Process..

[6]  Gyeonghwan Kim,et al.  Handwritten word recognition for real-time applications , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[7]  Nils J. Nilsson,et al.  Learning Machines: Foundations of Trainable Pattern-Classifying Systems , 1965 .

[8]  J. K. Hawkins Self-Organizing Systems-A Review and Commentary , 1961, Proceedings of the IRE.

[9]  Fumitaka Kimura,et al.  Handwritten word recognition using lexicon free and lexicon directed word recognition algorithms , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[10]  Jung-Hsien Chiang,et al.  Hybrid fuzzy-neural systems in handwritten word recognition , 1997, IEEE Trans. Fuzzy Syst..

[11]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  Jung-Hsien Chiang,et al.  Handwritten word recognition with character and inter-character neural networks , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[13]  Jonathan J. Hull,et al.  A Database for Handwritten Text Recognition Research , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Paul D. Gader,et al.  Fusion of handwritten word classifiers , 1996, Pattern Recognit. Lett..

[15]  Paul D. Gader,et al.  Handprinted word recognition on a NIST data set , 2005, Machine Vision and Applications.

[16]  Paramvir Bahl,et al.  Recognition of handwritten word: first and second order hidden Markov model based approach , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Sadik Kapadia,et al.  Discriminative Training of Hidden Markov Models , 1998 .

[18]  Jung-Hsien Chiang,et al.  Comparison of crisp and fuzzy character neural networks in handwritten word recognition , 1995, IEEE Trans. Fuzzy Syst..

[19]  Paul D. Gader,et al.  Word-level optimization of dynamic programming-based handwritten word recognition algorithms , 1999, Electronic Imaging.