ADAPTIVE COMMITTEES OF NEURAL CLASSIFIERS

It is obvious that combination of several classifiers might improve overall classification performance. In this paper, on the contrary to the ordinary approach of utilising all neural networks available to make the committee decision, we propose to create adaptive committees, which are specific for each input data point. A prediction neural network is used to identify classifiers to be fused for making a committee decision about the given input data. The proposed technique is tested in three aggregation schemes and the effectiveness of the approach is demonstrated on the three real data sets.

[1]  Arunas Lipnickas,et al.  Classifiers Fusion with Data Dependent Aggregation Schemes , 2002 .

[2]  Antanas Verikas,et al.  Fusing Neural Networks Through Space Partitioning and Fuzzy Integration , 2002, Neural Processing Letters.

[3]  Antanas Verikas,et al.  Soft combination of neural classifiers: A comparative study , 1999, Pattern Recognit. Lett..

[4]  Jozef Korbicz,et al.  Adaptive selection of neural networks for a committee decision , 2003, Second IEEE International Workshop on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications, 2003. Proceedings.

[5]  Antanas Verikas,et al.  FUSING NEURAL NETWORKS THROUGH FUZZY INTEGRATION , 2001 .

[6]  Leo Breiman,et al.  HALF&HALF BAGGING AND HARD BOUNDARY POINTS , 1998 .

[7]  Ludmila I. Kuncheva,et al.  Measures of Diversity in Classifier Ensembles and Their Relationship with the Ensemble Accuracy , 2003, Machine Learning.