Local Bayesian Based Rejection Method for HSC Ensemble

Based on Jordan Curve Theorem, a universal classification method, called Hyper Surface Classifier (HSC) was proposed in 2002 Experiments showed the efficiency and effectiveness of this algorithm Afterwards, an ensemble manner for HSC(HSC Ensemble), which generates sub classifiers with every 3 dimensions of data, has been proposed to deal with high dimensional datasets However, as a kind of covering algorithm, HSC Ensemble also suffers from rejection which is a common problem in covering algorithms In this paper, we propose a local bayesian based rejection method(LBBR) to deal with the rejection problem in HSC Ensemble Experimental results show that this method can significantly reduce the rejection rate of HSC Ensemble as well as enlarge the coverage of HSC As a result, even for datasets of high rejection rate more than 80%, this method can still achieve good performance.

[1]  Robert P. W. Duin,et al.  A combining strategy for ill-defined problems , 2006 .

[2]  Wu Tao.  Kernel Covering Algorithm for Machine Learning , 2005 .

[3]  Zhongzhi Shi,et al.  A novel classification method based on hypersurface , 2003 .

[4]  Robert P. W. Duin,et al.  The interaction between classification and reject performance for distance-based reject-option classifiers , 2006, Pattern Recognit. Lett..

[5]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[6]  Johannes Fürnkranz,et al.  ROC ‘n’ Rule Learning—Towards a Better Understanding of Covering Algorithms , 2005, Machine Learning.

[7]  Jacek M. Zurada,et al.  Advances in Neural Networks - ISNN 2006, Third International Symposium on Neural Networks, Chengdu, China, May 28 - June 1, 2006, Proceedings, Part I , 2006, International Symposium on Neural Networks.

[8]  Bo Zhang,et al.  A geometrical representation of McCulloch-Pitts neural model and its applications , 1999, IEEE Trans. Neural Networks.

[9]  Qing He,et al.  Classification based on dimension transposition for high dimension data , 2007, Soft Comput..

[10]  Qing He,et al.  Minimal Consistent Subset for Hyper Surface Classification Method , 2008, Int. J. Pattern Recognit. Artif. Intell..

[11]  Bernard Dubuisson,et al.  A statistical decision rule with incomplete knowledge about classes , 1993, Pattern Recognit..

[12]  Zhou Ying,et al.  Probabilistic Model for Covering Algorithm , 2007 .

[13]  Qing He,et al.  HyperSurface Classifiers Ensemble for High Dimensional Data Sets , 2006, ISNN.