Dynamic Classifier Ensemble Selection Based on GMDH

Dynamic classifier selection (DCS) plays a strategic role in the field of multiple classifiers system. This article introduces group method of data handing(GMDH) theory to DCS, and presents a novel strategy GAES for adaptive classifier ensemble selection first. Then it extends this algorithm and proposes dynamic classifier ensemble selection based on GMDH (GDES). For each test pattern, GDES is able to select an appropriate ensemble from the classifier pool adaptively, determine the combination weights among base classifiers, and complete the combination process automatically. We experimentally test GDES over 6 UCI data sets. The results clearly show that, GDES outperforms the fusion method MAJ (Xu et al., 1992) and also performs slightly better than DCS-LCA (Woods et al., 1997) and KNORA (Ko et al., 2008).

[1]  F. Lemke,et al.  Self-Organising Data Mining , 2003 .

[2]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[3]  Fabio Roli,et al.  A theoretical and experimental analysis of linear combiners for multiple classifier systems , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Vicenç Puig,et al.  A GMDH neural network-based approach to passive robust fault detection using a constraint satisfaction backward test , 2007, Eng. Appl. Artif. Intell..

[5]  Johannes R. Sveinsson,et al.  Parallel consensual neural networks , 1997, IEEE Trans. Neural Networks.

[6]  Paul C. Smits,et al.  Multiple classifier systems for supervised remote sensing image classification based on dynamic classifier selection , 2002, IEEE Trans. Geosci. Remote. Sens..

[7]  Michael C. Fairhurst,et al.  Diversity in multiple classifier ensembles based on binary feature quantisation with application to face recognition , 2008, Appl. Soft Comput..

[8]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[9]  James C. Bezdek,et al.  Decision templates for multiple classifier fusion: an experimental comparison , 2001, Pattern Recognit..

[10]  Robert Sabourin,et al.  From dynamic classifier selection to dynamic ensemble selection , 2008, Pattern Recognit..

[11]  Kevin W. Bowyer,et al.  Combination of Multiple Classifiers Using Local Accuracy Estimates , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jon Atli Benediktsson,et al.  Multiple Classifier Systems in Remote Sensing: From Basics to Recent Developments , 2007, MCS.

[13]  G. Pask,et al.  Heuristic Self-Organization in Problems of Engineering Cybernetics , 2003 .

[14]  Gian Luca Marcialis,et al.  A study on the performances of dynamic classifier selection based on local accuracy estimation , 2005, Pattern Recognit..