Serial Combination of Multiple Experts: A Unified Evaluation

Abstract: Multiple expert decision combination has received much attention in recent years. This is a multi-disciplinary branch of pattern recognition which has extensive applications in numerous fields including robotic vision, artificial intelligence, document processing, office automation, human-computer interfaces, data acquisition, storage and retrieval, etc. In recent years, this application area has been extended to forensic science, including the identification of individuals using measures depending on biometrics, security and other applications. In this paper, a generalised multi-expert multi-level decision combination strategy, the serial combination approach, has been investigated from the dual viewpoints of theoretical analysis and practical implementation. Different researchers have implicitly utilised various approaches based on this concept over the years in a wide spectrum of application domains, but a comprehensive, coherent and generalised presentation of this approach from both theoretical and implementation viewpoints has not been attempted. While presenting here a unified framework for serial multiple expert decision combination, it is shown that many multi-expert approaches reported in the literature can be easily represented within the proposed framework. Detailed theoretical and practical discussions of the various performance results with these combinations, analysis of the internal processing of this approach, a case study for testing the theoretical framework, issues relating to processing overheads associated with the implementation of this approach, general comments on its applicability to various task domains and the generality of the approach in terms of reevaluating previous research have also been incorporated.

[1]  Fuad Rahman,et al.  Introducing New Multiple Expert Decision Combination Topologies: A Case Study using Recognition of Handwritten Characters , 1997, ICDAR.

[2]  Roland T. Chin,et al.  An Automated Approach to the Design of Decision Tree Classifiers , 1982 .

[3]  Marek Kurzynski.  On the identity of optimal strategies for multistage classifiers , 1989, Pattern Recognit. Lett..

[4]  G. Dimauro,et al.  A Multi-Expert Signature Verification System for Bankcheck Processing , 1997, Int. J. Pattern Recognit. Artif. Intell..

[5]  G. Saon,et al.  Off-line handwritten word recognition using a mixed HMM-MRF approach , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[6]  Louis Vuurpijl,et al.  Finding structure in diversity: a hierarchical clustering method for the categorization of allographs in handwriting , 1997, Proceedings of the Fourth International Conference on Document Analysis and Recognition.

[7]  Lashon B. Booker,et al.  Intelligent Behavior as an Adaptation to the Task Environment , 1982 .

[8]  Nikolai Gorski,et al.  The A2iA Intercheque System: Courtesy Amount and Legal Amount Recognition for French Checks , 1997, Int. J. Pattern Recognit. Artif. Intell..

[9]  J. Kittler,et al.  Multistage pattern recognition with reject option , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.

[10]  Michael Fairhurst,et al.  Configuration selection for two-layer memory network pattern classifiers , 1985 .

[11]  Nasser Sherkat,et al.  Multiple recognizer combination topologies , 1996 .

[12]  Edouard Lethelier,et al.  Automatic Reading of Handwritten Amounts on French Checks , 1997, Int. J. Pattern Recognit. Artif. Intell..

[13]  King-Sun Fu,et al.  Automated classification of nucleated blood cells using a binary tree classifier , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  M. Giger,et al.  Computer vision and artificial intelligence in mammography. , 1994, AJR. American journal of roentgenology.

[15]  Fumitaka Kimura,et al.  Handwritten numerical recognition based on multiple algorithms , 1991, Pattern Recognit..

[16]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[17]  Edouard Lethelier,et al.  An automatic reading system for handwritten numeral amounts on French checks , 1995, Proceedings of 3rd International Conference on Document Analysis and Recognition.

[18]  Yves Lecourtier,et al.  Multi-Bank Check Recognition System: Consideration on The Numeral Amount Recognition Module , 1997, Int. J. Pattern Recognit. Artif. Intell..

[19]  Jerzy Józefczyk.  Determination of optimal recognition algorithms in the two-level system , 1986, Pattern Recognit. Lett..

[20]  Simon M. Lucas,et al.  Statistical syntactic methods for high-performance OCR , 1996 .

[21]  Thomas H. Reiss,et al.  Recognizing Planar Objects Using Invariant Image Features , 1993, Lecture Notes in Computer Science.

[22]  Fuad Rahman,et al.  An Evaluation Of Multi-Expert Configurations For The Recognition Of Handwritten Numerals , 1998, Pattern Recognit..

[23]  Wolfgang Doster,et al.  A decision theoretic approach to hierarchical classifier design , 1984, Pattern Recognit..

[24]  Ching Y. Suen,et al.  Structural classification and relaxation matching of totally unconstrained handwritten zip-code numbers , 1988, Pattern Recognit..

[25]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[26]  Michael C. Fairhurst,et al.  An interactive two-level architecture for a memory network pattern classifier , 1990, Pattern Recognit. Lett..

[27]  Fuad Rahman,et al.  A new hybrid approach in combining multiple experts to recognise handwritten numerals , 1997, Pattern Recognit. Lett..

[28]  Yuan Yan Tang,et al.  Multiple-level information source and entropy-reduced transformation models , 1991, Pattern Recognit..

[29]  Michael C. Fairhurst,et al.  An Evaluation of Parallel Strategies for Feature Vector Construction in Automatic Signature Verification Systems , 1994, Int. J. Pattern Recognit. Artif. Intell..

[30]  Ching Y. Suen,et al.  Analysis and Design of a Decision Tree Based on Entropy Reduction and Its Application to Large Character Set Recognition , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Michael C. Fairhurst,et al.  Performance comparisons in hierarchical architectures for memory network pattern classifiers , 1986, Pattern Recognit. Lett..

[32]  Yuan Yan Tang,et al.  Automatic document processing: A survey , 1996, Pattern Recognit..

[33]  Michael C. Fairhurst,et al.  A two-layer memory network architecture for a pattern classifier , 1983, Pattern Recognit. Lett..

[34]  Herbert A. Glucksman.  Multicategory Classification of Patterns Represented by High-Order Vectors of Multilevel Measurements , 1971, IEEE Transactions on Computers.

[35]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[36]  Fuad Rahman,et al.  Design considerations in the real-time implementation of multiple expert image classifiers within a modular and flexible multiple-platform design environment , 1998, Real Time Imaging.

[37]  Charles E. Taylor.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Complex Adaptive Systems.John H. Holland , 1994 .

[38]  Zheru Chi,et al.  Handwritten numeral recognition using self-organizing maps and fuzzy rules , 1995, Pattern Recognit..