Adaptive Parameterized AdaBoost Algorithm with application in EEG Motor Imagery Classification

Among different machine learning algorithms AdaBoost is a classification technique, which improves the classification accuracy by increasing the weights of the misclassified data. To overcome the problem of misclassification in Real AdaBoost algorithm, of the already classified samples, concept of margin is employed in the Parameterized AdaBoost algorithm. The new parameter, introduced in Parameterized AdaBoost, corresponding to the margin is chosen randomly between 0 to 1. However, the margin value is different for different classification problem. Hence, in this paper, the parameter corresponding to the margin is adapted by learning the parameter value with the help of Differential Evolutionary algorithm corresponding to the optimal classification accuracy. Experiment for the support of the proposed Adaptive Parameterized AdaBoost Algorithm has been conducted with different standard database given by UCI Machine Learning Repository. In addition, an application of Adaptive Parameterized AdaBoost is performed in EEG Motor Imagery Classification. Finally the EEG Motor Imagery Classified data (Left/Right) is tested in a robot.

[1]  Gunnar Rätsch,et al.  Soft Margins for AdaBoost , 2001, Machine Learning.

[2]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[3]  Hiroshi Nagahashi,et al.  Parameterized AdaBoost: Introducing a Parameter to Speed Up the Training of Real AdaBoost , 2014, IEEE Signal Processing Letters.

[4]  Yanfeng Zhang,et al.  A revised AdaBoost algorithm: FM-AdaBoost , 2010, International Conference on Computer Application and System Modeling.

[5]  P. N. Suganthan,et al.  Differential Evolution: A Survey of the State-of-the-Art , 2011, IEEE Transactions on Evolutionary Computation.

[6]  Rainer Storn,et al.  Differential Evolution-A simple evolution strategy for fast optimization , 1997 .

[7]  Wenxin Jiang,et al.  Some Theoretical Aspects of Boosting in the Presence of Noisy Data , 2001, ICML.

[8]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[9]  Virginia Wheway,et al.  Using Boosting to Detect Noisy Data , 2000, PRICAI Workshops.

[10]  K. Price.  Differential evolution vs. the functions of the 2/sup nd/ ICEO , 1997, Proceedings of 1997 IEEE International Conference on Evolutionary Computation (ICEC '97).

[11]  Hong Qiao,et al.  An Efficient Tree Classifier Ensemble-Based Approach for Pedestrian Detection , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  Stan Z. Li,et al.  FloatBoost learning and statistical face detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Anneleen Van Assche,et al.  Ensemble Methods for Noise Elimination in Classification Problems , 2003, Multiple Classifier Systems.

[14]  Yun Yang,et al.  Time Series Clustering Via RPCL Network Ensemble With Different Representations , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Fernando Lopes da Silva,et al.  Comprar Niedermeyer's Electroencephalography, 6/e (Basic Principles, Clinical Applications, and Related Fields ) | Fernando Lopes Da Silva | 9780781789424 | Lippincott Williams & Wilkins , 2010 .

[16]  Olcay Taner Yildiz,et al.  Omnivariate Rule Induction Using a Novel Pairwise Statistical Test , 2013, IEEE Transactions on Knowledge and Data Engineering.

[17]  Mercedes Fernández-Redondo,et al.  Improving Adaptive Boosting with k-Cross-Fold Validation , 2006, ICIC.

[18]  Jian-Jiun Ding,et al.  Salient Region Detection Improved by Principle Component Analysis and Boundary Information , 2013, IEEE Transactions on Image Processing.

[19]  R. Andersen,et al.  Selecting the signals for a brain–machine interface , 2004, Current Opinion in Neurobiology.

[20]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[21]  Bingyan Zhao,et al.  Novel Binary Differential Evolution Algorithm for Discrete Optimization , 2009, 2009 Fifth International Conference on Natural Computation.

[22]  Touradj Ebrahimi,et al.  Electroencephalogram alterations during perception of pleasant and unpleasant odors , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[23]  Jian Li,et al.  Two new regularized AdaBoost algorithms , 2004, 2004 International Conference on Machine Learning and Applications, 2004. Proceedings..

[24]  Alexander Vezhnevets,et al.  ‘ Modest AdaBoost ’ – Teaching AdaBoost to Generalize Better , 2005 .

[25]  Y. Freund,et al.  Discussion of the Paper \additive Logistic Regression: a Statistical View of Boosting" By , 2000 .

[26]  Rocco A. Servedio,et al.  Boosting in the presence of noise , 2003, STOC '03.

[27]  Gonzalo Martínez-Muñoz,et al.  Using all data to generate decision tree ensembles , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[28]  Changle Zhou,et al.  Objective Classification Using Advanced Adaboost Algorithm , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[29]  Rainer Storn,et al.  Minimizing the real functions of the ICEC'96 contest by differential evolution , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[30]  Cuntai Guan,et al.  An adaptive filter bank for motor imagery based Brain Computer Interface , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Nikunj C. Oza,et al.  AveBoost2: Boosting for Noisy Data , 2004, Multiple Classifier Systems.

[32]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[33]  Rocco A. Servedio,et al.  Smooth boosting and learning with malicious noise , 2003 .

[34]  A. Walker.  Electroencephalography, Basic Principles, Clinical Applications and Related Fields , 1982 .

[35]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..