Hybrid generative/discriminative classifier for unconstrained character recognition

Handwriting recognition for hand-held devices like PDAs requires very accurate and adaptive classifiers. It is such a complex classification problem that it is quite usual now to make co-operate several classification methods. In this paper, we present an original two stages recognizer. The first stage is a model-based classifier which store an exhaustive set of character models. The second stage is a pairwise classifier which separate the most ambiguous pairs of classes. This hybrid architecture is based on the idea that the correct class almost systematically belongs to the two more relevant classes found by the first classifier. Experiments on a 80,000 examples database show a 30% improvement on a 62 classes recognition problem. Moreover, we show experimentally that such an architecture suits perfectly for incremental classification.

[1]  Rajjan Shinghal,et al.  A hybrid classifier for recognizing handwritten numerals , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[2]  Jin Wang,et al.  Resolving multifont character confusion with neural networks , 1993, Pattern Recognit..

[3]  Anil K. Jain,et al.  Writer adaptation of online handwriting models , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[4]  Sargur N. Srihari,et al.  On-Line and Off-Line Handwriting Recognition: A Comprehensive Survey , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Louis Vuurpijl,et al.  Architectures for detecting and solving conflicts: two-stage classification and support vector classifiers , 2003, Document Analysis and Recognition.

[6]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[7]  Lionel Prevost,et al.  Modelizing character allographs in omni-scriptor frame: a new non-supervised clustering algorithm , 2000, Pattern Recognit. Lett..

[8]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Patrick Gallinari,et al.  An MLP-SVM combination architecture for offline handwritten digit recognition , 2003, Document Analysis and Recognition.

[10]  Rajat Raina,et al.  Classification with Hybrid Generative/Discriminative Models , 2003, NIPS.

[11]  Gérard Dreyfus,et al.  Pairwise Neural Network Classifiers with Probabilistic Outputs , 1994, NIPS.

[12]  I Avi-ItzhakHadar,et al.  High Accuracy Optical Character Recognition Using Neural Networks with Centroid Dithering , 1995 .

[13]  Jorma Laaksonen,et al.  Influence of erroneous learning samples on adaptation in on-line handwriting recognition , 2002, Pattern Recognit..

[14]  Maurice Milgram,et al.  Constraint tangent distance for on-line character recognition , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[15]  Fuad Rahman,et al.  Multiple classifier decision combination strategies for character recognition: A review , 2003, Document Analysis and Recognition.

[16]  Ching Y. Suen,et al.  A class-modular feedforward neural network for handwriting recognition , 2002, Pattern Recognit..

[17]  Lionel Prevost,et al.  Static and dynamic classifier fusion for character recognition , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[18]  Isabelle Guyon,et al.  UNIPEN project of on-line data exchange and recognizer benchmarks , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[19]  Robert Sabourin,et al.  Speeding up the decision making of support vector classifiers , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[20]  Lionel Prevost,et al.  An activation-verification model for on-line texts recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[21]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[22]  Isabelle Guyon,et al.  Design of a neural network character recognizer for a touch terminal , 1991, Pattern Recognit..

[23]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[24]  Hadar I. Avi-Itzhak,et al.  High Accuracy Optical Character Recognition Using Neural Networks with Centroid Dithering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..