A novel hybrid classifier for recognition of handwritten numerals

A hybrid neural network and tree classification system for handwritten numeral recognition is proposed. The recognition system consists of coarse and fine classification based on a variety of stable and reliable global features and local features. For the coarse classifier: a four-layer feedforward neural network with backpropagation learning algorithm is employed to distinguish six subsets {0}, {6}, {8}, {1,7}, {4,9}, {2,3,5} based on the similarity of character's geometrical features. Three character classes {0}, {6} and {8} are directly recognized from ANN. For each of the last three subsets, a decision tree classifier is built for fine classification as follows: firstly, the specific feature-class relationship is heuristically and empirically created between the feature primitives and corresponding semantic class. Then, an iterative growing and pruning algorithm is used to form a tree classifier. Experiments demonstrated that the proposed hybrid recognition system is robust and flexible, which can achieve a high recognition rate.

[1]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[2]  Ishwar K. Sethi Neural implementation of tree classifiers , 1995, IEEE Trans. Syst. Man Cybern..

[3]  Michael T. Manry,et al.  Comparisons of a neural network and a nearest-neighbor classifier via the numeric handprint recognition problem , 1995, IEEE Trans. Neural Networks.

[4]  Adnan Amin,et al.  Hand printed Arabic character recognition system , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 3 - Conference C: Signal Processing (Cat. No.94CH3440-5).

[5]  Ping Zhang,et al.  A floating feature detector for handwritten numeral recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[6]  Hong Yan,et al.  Handwritten digit recognition by adaptive-subspace self-organizing map (ASSOM) , 1999, IEEE Trans. Neural Networks.

[7]  Adnan Amin,et al.  Hand-printed arabic character recognition system using an artificial network , 1996, Pattern Recognit..

[8]  Edward J. Delp,et al.  An Iterative Growing and Pruning Algorithm for Classification Tree Design , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Saul B. Gelfand,et al.  Classification trees with neural network feature extraction , 1992, IEEE Trans. Neural Networks.

[10]  I. K. Sethi,et al.  Hierarchical Classifier Design Using Mutual Information , 1982, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  R. Krishnan,et al.  Extracting decision trees from trained neural networks , 1999, Pattern Recognit..

[12]  Ching Y. Suen,et al.  Large Tree Classifier with Heuristic Search and Global Training , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Paul D. Gader,et al.  Automatic Feature Generation for Handwritten Digit Recognition , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Šarūnas Raudys Neural Network Classifiers , 2001 .

[15]  Olcay Boz,et al.  Extracting decision trees from trained neural networks , 2002, KDD.

[16]  Sung-Bae Cho,et al.  Neural-network classifiers for recognizing totally unconstrained handwritten numerals , 1997, IEEE Trans. Neural Networks.