Genetic Algorithms for Multi-classifier System Configuration: A Case Study in Character Recognition

We describe a multiple classifier system which incorporates an automatic self-configuration scheme based on genetic algorithms. Our main interest in this paper is focused on exploring the statistical properties of the resulting multi-expert configurations. To this end we initially test the proposed system on a series of tasks of increasing difficulty drawn from the domain of character recognition. We then proceed to investigate the performance of our system not only in comparison to that of its constituent classifiers, but also in comparison to an independent set of individually optimised classifiers. Our results illustrate that significant gains can be obtained by integrating a genetic algorithm based optimisation process into multi-classifier schemes both in the performance enhancement and in the reduction of its volatility, especially as the task domain becomes more complex.

[1]  Simon M. Lucas Can scanning n-tuple classifiers be improved by pre-transforming training data? , 1996 .

[2]  Thomas G. Dietterich Machine-Learning Research Four Current Directions , 1997 .

[3]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[4]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[5]  Charles E. Taylor Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence. Complex Adaptive Systems.John H. Holland , 1994 .

[6]  Fuad Rahman,et al.  An Evaluation Of Multi-Expert Configurations For The Recognition Of Handwritten Numerals , 1998, Pattern Recognit..

[7]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Fuad Rahman,et al.  Machine-printed character recognition revisited: re-application of recent advances in handwritten character recognition research , 1998, Image Vis. Comput..

[9]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .

[10]  John Illingworth,et al.  Combination of HMMs for the representation of printed characters in noisy document images , 1995, Image Vis. Comput..

[11]  Michael Fairhurst,et al.  Moving window classifier: approach to off-line image recognition , 2000 .

[12]  Lakhmi C. Jain,et al.  Designing classifier fusion systems by genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[13]  Ahmad Fuad Rezaur Rahman,et al.  Automatic self-configuration of a novel multiple-expert classifier using a genetic algorithm , 1999 .