An Ensemble Classification Method Based on Input Clustering and Classifiers Expected Reliability

In this paper a novel ensemble method (EM) for classification tasks is described. The proposed approach is based on the use of a set of classifiers, each of which is trained by exploiting a different subset of the available training data, which are created by partitioning the input space by means of a self organizing map (SOM) based clustering algorithm. Subsequently, the reliability of each classifier belonging to the ensemble is measured according to the classification accuracy on whole dataset and each classifier is associated to a feed forward neural network, which is able to self-estimate the reliability of single classifiers when coping with a new data. The estimated reliabilities are used in the ensemble aggregation phase in order to provide the final classification of new patterns. The method, tested on literature datasets coming from the UCI repository, achieved satisfactory results improving the classification accuracy with respect to other popular ensemble techniques.

[1]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[2]  H. Hirose,et al.  More accurate diagnosis in electric power apparatus conditions using ensemble classification methods , 2011, IEEE Transactions on Dielectrics and Electrical Insulation.

[3]  Nasser Yazdani,et al.  Application of ensemble models in web ranking , 2010, 2010 5th International Symposium on Telecommunications.

[4]  Leonardo Maria Reyneri,et al.  Self-estimation of Data and Approximation Reliability through Neural Networks , 2009, IWANN.

[5]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[6]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[7]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[8]  Teuvo Kohonen,et al.  Self-organized formation of topologically correct feature maps , 2004, Biological Cybernetics.

[9]  Bernhard Sick,et al.  Forecasting exchange rates with ensemble neural networks and ensemble K-PLS: A case study for the US Dollar per Indian Rupee , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[10]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[11]  Lars Kai Hansen,et al.  Neural Network Ensembles , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Daniel P. Lopresti,et al.  A classifier ensemble based on performance level estimation , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[14]  Cheng Cheng,et al.  A Comparison of Ensemble Methods in Financial Market Prediction , 2012, 2012 Fifth International Joint Conference on Computational Sciences and Optimization.