Boosting Effect of Classifier Based on Simple Granules of Knowledge

. (THIS IS THE FIRST VERSION, I WILL PROVIDE A CORRECTION IN A FEW DAYS TIME, AND THE RESULTS WILL BE DESCRIBED IN DETAIL)The idea of classification based on simple granules of knowledge (CSG classifier) is inspired by granular structures proposed by Polkowski. The simple granular classifier turned up to be really effective in the context of real data classification. Classifier among others turned out to be resistant for damages and can absorb missing values. In this work we have presented the continuation of series of experimentations with boosting of rough set classifiers. In this work we have checked a few methods for classifier stabilization in the context of CSG classifier - Bootstrap Ensemble (Simple Bagging), Boosting based on Arcing, and Ada-Boost with Monte Carlo split. We have performed experiments on selected data from the UCI Repository. For the smaller radii we have huge unprecise classificaiton granules, and the best result was obtain for the first radius after 0.5, where the size of classification granules was about 4,5 percent of size of original decision system. For the higher radii starting from 0.642857 classification granule size is really small and the classification is worse. *extended version of paper „Ensemble of Classifiers Based on Simple Granules of Knowledge” presented at the 23rd International Conference on Information and Software Technologies (ICIST 2017) held on 12-14 October, 2017 in Druskininkai, LithuaniaDOI: http://dx.doi.org/10.5755/j01.itc.47.2.19675

[1]  Lech Polkowski A Unified Approach to Granulation of Knowledge and Granular Computing Based on Rough Mereology: A Survey , 2008 .

[2]  L. Breiman Arcing classifier (with discussion and a rejoinder by the author) , 1998 .

[3]  C. A. Murthy,et al.  Rough set Based Ensemble Classifier for Web Page Classification , 2006 .

[4]  Guoyin Wang,et al.  Rough Sets, Fuzzy Sets, Data Mining, and Granular Computing , 2013, Lecture Notes in Computer Science.

[5]  Mahmoud Taleb Beidokhti,et al.  Advances in Intelligent Systems and Computing , 2016 .

[6]  László Györfi,et al.  A Probabilistic Theory of Pattern Recognition , 1996, Stochastic Modelling and Applied Probability.

[7]  Xiaohua Hu,et al.  Ensembles of classifiers based on rough sets theory and set-oriented database operations , 2006, 2006 IEEE International Conference on Granular Computing.

[8]  Lech Polkowski,et al.  Granular Computing in Decision Approximation - An Application of Rough Mereology , 2015, Intelligent Systems Reference Library.

[10]  Robert E. Schapire,et al.  The Boosting Approach to Machine Learning An Overview , 2003 .

[11]  Piotr Artiemjew,et al.  Natural versus Granular Computing: Classifiers from Granular Structures , 2008, RSCTC.

[12]  Robert Nowicki,et al.  Application of Rough Sets in k Nearest Neighbours Algorithm for Classification of Incomplete Samples , 2014, KICSS.

[13]  Dirk Van,et al.  Ensemble Methods: Foundations and Algorithms , 2012 .

[14]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .