An ensemble classifier for offline cursive character recognition using multiple feature extraction techniques

This paper presents a novel approach for cursive character recognition by using multiple feature extraction algorithms and a classifier ensemble. Several feature extraction techniques, using different approaches, are extracted and evaluated. Two techniques, Modified Edge Maps and Multi Zoning, are proposed. The former one presents the best overall result. Based on the results, a combination of the feature sets is proposed in order to achieve high recognition performance. This combination is motivated by the observation that the feature sets are both, independent and complementary. The ensemble is performed by combining the outputs generated by the classifier in each feature set separately. Both fixed and trained combination rules are evaluated using the C-Cube database. A trained combination scheme using a MLP network as combiner achieves the best results which is also the best results for the C-Cube database by a good margin.

[1]  Robert P. W. Duin,et al.  The combining classifier: to train or not to train? , 2002, Object recognition supported by user interaction for service robots.

[2]  John Thornton,et al.  Offline Cursive Character Recognition: A state of the art comparison , 2009 .

[3]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[4]  Nikos Fakotakis,et al.  Handwritten word recognition based on structural characteristics and lexical support , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[5]  M. Stone.  Cross‐Validatory Choice and Assessment of Statistical Predictions , 1976 .

[6]  Ching Y. Suen,et al.  A trainable feature extractor for handwritten digit recognition , 2007, Pattern Recognit..

[7]  Lambert Schomaker,et al.  Writer Style from Oriented Edge Fragments , 2003, CAIP.

[8]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[9]  Francesco Camastra,et al.  A SVM-based cursive character recognizer , 2007, Pattern Recognit..

[10]  Luiz Eduardo Soares de Oliveira,et al.  Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Marc'Aurelio Ranzato,et al.  Sparse Feature Learning for Deep Belief Networks , 2007, NIPS.

[12]  Lambert Schomaker,et al.  Automatic writer identification using connected-component contours and edge-based features of uppercase Western script , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[14]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[15]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[16]  John Thornton,et al.  Character Recognition Using Hierarchical Vector Quantization and Temporal Pooling , 2008, Australasian Conference on Artificial Intelligence.

[17]  Josef Kittler,et al.  Combining multiple classifiers by averaging or by multiplying? , 2000, Pattern Recognit..

[18]  Ping Zhang,et al.  Reliable recognition of handwritten digits using a cascade ensemble classifier system and hybrid features , 2006 .

[19]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[20]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Ashraf A. Kassim,et al.  Dual classifier system for handprinted alphanumeric character recognition , 1998, Pattern Analysis and Applications.

[22]  Francesco Camastra,et al.  Offline Cursive Character Challenge: a New Benchmark for Machine Learning and Pattern Recognition Algorithms. , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[23]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[24]  Andreas Schlapbach.  Writer identification and verification , 2008 .