From static to dynamic ensemble of classifiers selection: Application to Arabic handwritten recognition

Arabic handwriting word recognition is a challenging problem due to Arabic's connected letter forms, consonantal diacritics and rich morphology. One way to improve the recognition rates classification task is to improve the accuracy of individual classifiers; another, is to apply ensemble of classifiers methods. To select the best classifier set from a pool of classifiers, the classifier diversity is considered one of the most important properties in static classifier selection. However, the advantage of dynamic ensemble selection versus static classifier selection is that used classifier set depends critically on the test pattern. In this paper, we propose two approaches for Arabic handwriting recognition AHR based on static and dynamic ensembles of classifiers selection. The first one selects statically the best set of classifiers from a pool of classifier already designed based on diversity measures. The second one represents a new algorithm based on Dynamic Ensemble of Classifiers Selection using Local Reliability measure DECS-LR. It chooses the most confident ensemble of classifiers to label each test sample dynamically. Such a level of confidence is measured by calculating the proposed local reliability measure using confusion matrixes constructed during training level. We show experimentally that both approaches provide encouraging results with the second one leading to a better recognition rate for AHR system using IFN_ENIT database.

[1]  Mokhtar Sellami,et al.  Classifiers combination and syntax analysis for Arabic literal amount recognition , 2006, Eng. Appl. Artif. Intell..

[2]  Mokhtar Sellami,et al.  Semi-continuous HMMs with explicit state duration for unconstrained Arabic word modeling and recognition , 2008, Pattern Recognit. Lett..

[3]  Maneesha Singh,et al.  A dynamic classifier selection and combination approach to image region labelling , 2005, Signal Process. Image Commun..

[4]  Volker Märgner,et al.  Baseline estimation for Arabic handwritten words , 2002, Proceedings Eighth International Workshop on Frontiers in Handwriting Recognition.

[5]  Marek Kurzynski,et al.  A Measure of Competence Based on Randomized Reference Classifier for Dynamic Ensemble Selection , 2010, 2010 20th International Conference on Pattern Recognition.

[6]  Venu Govindaraju,et al.  Holistic handwritten word recognition using temporal features derived from off-line images , 1996, Pattern Recognit. Lett..

[7]  Mokhtar Sellami,et al.  Perceptual Recognition of Arabic Literal Amounts , 2006, Comput. Artif. Intell..

[8]  Robert Sabourin,et al.  Dynamic Zoning Selection for Handwritten Character Recognition , 2011, CIARP.

[9]  Fabio Roli,et al.  Information fusion in computer security , 2009, Inf. Fusion.

[10]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Vasile Palade,et al.  Automatic fuzzy rule base generation for on-line handwritten alphanumeric character recognition , 2005, Int. J. Knowl. Based Intell. Eng. Syst..

[12]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[13]  Sebastiano Impedovo,et al.  Frontiers in Handwriting Recognition , 1994 .

[14]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[15]  Vasile Palade,et al.  Multi-Classifier Systems: Review and a roadmap for developers , 2006, Int. J. Hybrid Intell. Syst..

[16]  Vasile Palade,et al.  An Efficient Fuzzy Method for Handwritten Character Recognition , 2004, KES.

[17]  Robert Sabourin,et al.  A dynamic overproduce-and-choose strategy for the selection of classifier ensembles , 2008, Pattern Recognit..

[18]  Robert Sabourin,et al.  Dynamic Ensemble Selection for Off-Line Signature Verification , 2011, MCS.

[19]  Alessandro Vinciarelli,et al.  A survey on off-line Cursive Word Recognition , 2002, Pattern Recognit..

[20]  Robert Sabourin,et al.  Dynamic Selection of Ensembles of Classifiers Using Contextual Information , 2010, MCS.

[21]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Fumitaka Kimura,et al.  New Frontiers in Handwriting Recognition , 2009, Pattern Recognit..

[23]  Daniel J. Mashao,et al.  Combining classifier decisions for robust speaker identification , 2006, Pattern Recognit..

[24]  Robert P. W. Duin,et al.  Is independence good for combining classifiers? , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[25]  Geng Chen,et al.  Dynamic weighting ensemble classifiers based on cross-validation , 2011, Neural Comput. Appl..

[26]  Robert Sabourin,et al.  From dynamic classifier selection to dynamic ensemble selection , 2008, Pattern Recognit..

[27]  Walid Magdy,et al.  Arabic OCR Error Correction Using Character Segment Correction, Language Modeling, and Shallow Morphology , 2006, EMNLP.

[28]  Volker Märgner,et al.  Arabic Handwriting Recognition Competition , 2005, ICDAR.

[29]  Mokhtar Sellami,et al.  Using Diversity in Classifier Set Selection for Arabic Handwritten Recognition , 2010, MCS.

[30]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[31]  Kevin W. Bowyer,et al.  Combination of multiple classifiers using local accuracy estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Mokhtar Sellami,et al.  Ensemble classifier construction for Arabic handwritten recongnition , 2011, International Workshop on Systems, Signal Processing and their Applications, WOSSPA.

[33]  Michael C. Fairhurst,et al.  Diversity in multiple classifier ensembles based on binary feature quantisation with application to face recognition , 2008, Appl. Soft Comput..

[34]  R. Schapire The Strength of Weak Learnability , 1990, Machine Learning.

[35]  Mokhtar Sellami,et al.  OFF-LINE HANDWRITTEN WORD RECOGNITION USING ENSEMBLE OF CLASSIFIER SELECTION AND FEATURES FUSION , 2010 .

[36]  Gian Luca Marcialis,et al.  A study on the performances of dynamic classifier selection based on local accuracy estimation , 2005, Pattern Recognit..

[37]  Volker Märgner,et al.  ICDAR 2009-Arabic handwriting recognition competition , 2011, 2011 International Conference on Document Analysis and Recognition.

[38]  Fabio Roli,et al.  Dynamic classifier selection based on multiple classifier behaviour , 2001, Pattern Recognit..