Improving cascading classifiers with particle swarm optimization

This paper addresses the issue of class related reject thresholds for cascading classifier systems. It has been demonstrated in the literature that class related reject thresholds provide an error-reject tradeoff better than a single global threshold. In this work we argue that the error-reject tradeoff yielded by class-related reject thresholds can be further improved if a proper algorithm is used to find the thresholds. In light of this, we propose using a recently developed optimization algorithm called particle swarm optimization. It has been proved to be very effective in solving real valued global optimization problems. In order to show the benefits of such an algorithm, we have applied it to optimize the thresholds of a cascading classifier system devoted to recognize handwritten digits.

[1]  C. K. Chow,et al.  On optimum recognition error and reject tradeoff , 1970, IEEE Trans. Inf. Theory.

[2]  Russell C. Eberhart,et al.  Comparison between Genetic Algorithms and Particle Swarm Optimization , 1998, Evolutionary Programming.

[3]  Luiz Eduardo Soares de Oliveira,et al.  Automatic Recognition of Handwritten Numerical Strings: A Recognition and Verification Strategy , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[5]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[6]  Robert Sabourin,et al.  An optimized hill climbing algorithm for feature subset selection: evaluation on handwritten character recognition , 2004, Ninth International Workshop on Frontiers in Handwriting Recognition.

[7]  Fabio Roli,et al.  Reject option with multiple thresholds , 2000, Pattern Recognit..

[8]  J. Kittler,et al.  Multistage pattern recognition with reject option , 1992, Proceedings., 11th IAPR International Conference on Pattern Recognition. Vol.II. Conference B: Pattern Recognition Methodology and Systems.