Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset

Balanced dataset has been utilized by the previous human activity recognition algorithms to train the classifier. However, imbalanced dataset are ubiquitous in human activity recognition, especially in the case of abnormal activity detection. Though the class imbalance problem exists as a universal phenomenon in human activity recognition, few researches mentioned this problem and solved it. In order to reduce the influence of the imbalance datasets problem, the mixed-kernel based weighted extreme learning machine (MK-WELM) has been proposed in this paper. Considering that the performance of extreme learning machine (ELM) is greatly influenced by the choice of kernel, the mixed kernel method is proposed for ELM. In order to deal with the imbalanced problem, the cost sensitive method is utilized. The main idea of the cost sensitive method is that the cost of minority class increases with the misclassification rate. Considering the cost sensitive function and the mixed kernel method, the MK-WELM is constructed. Comparing with ELM and weighted ELM methods, experimental results over different human activity datasets demonstrate the effectiveness of the proposed method.

[1]  Gang Wang,et al.  A novel bankruptcy prediction model based on an adaptive fuzzy k-nearest neighbor method , 2011, Knowl. Based Syst..

[2]  Bo Zhang,et al.  Learning concepts from large scale imbalanced data sets using support cluster machines , 2006, MM '06.

[3]  Yiqiang Chen,et al.  Weighted extreme learning machine for imbalance learning , 2013, Neurocomputing.

[4]  Guang-Zhong Yang,et al.  Semi-supervised segmentation for activity recognition with Multiple Eigenspaces , 2008, 2008 5th International Summer School and Symposium on Medical Devices and Biosensors.

[5]  Hui Han,et al.  Borderline-SMOTE: A New Over-Sampling Method in Imbalanced Data Sets Learning , 2005, ICIC.

[6]  Jorma Laurikkala,et al.  Improving Identification of Difficult Small Classes by Balancing Class Distribution , 2001, AIME.

[7]  Min Han,et al.  Online sequential extreme learning machine with kernels for nonstationary time series prediction , 2014, Neurocomputing.

[8]  Chien-Hsing Chou,et al.  The Generalized Condensed Nearest Neighbor Rule as A Data Reduction Method , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Billur Barshan,et al.  Comparative study on classifying human activities with miniature inertial and magnetic sensors , 2010, Pattern Recognit..

[10]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[11]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[12]  Lei Wang,et al.  An Adaptive Approach to Learning Optimal Neighborhood Kernels , 2013, IEEE Transactions on Cybernetics.

[13]  Lei Wang,et al.  An Efficient Approach to Integrating Radius Information into Multiple Kernel Learning , 2013, IEEE Transactions on Cybernetics.

[14]  Matjaz Gams,et al.  An Agent-Based Approach to Care in Independent Living , 2010, AmI.

[15]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[16]  Q. M. Jonathan Wu,et al.  Human action recognition using extreme learning machine based on visual vocabularies , 2010, Neurocomputing.

[17]  Xiaoou Li,et al.  Using Genetic Algorithm to Improve Classification Accuracy on Imbalanced Data , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[18]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[19]  Weihua Sheng,et al.  Human daily activity recognition in robot-assisted living using multi-sensor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Alexandros Iosifidis,et al.  Dynamic action recognition based on dynemes and Extreme Learning Machine , 2013, Pattern Recognit. Lett..

[21]  Jianping Yin,et al.  Boosting weighted ELM for imbalanced learning , 2014, Neurocomputing.

[22]  Gongping Yang,et al.  On the Class Imbalance Problem , 2008, 2008 Fourth International Conference on Natural Computation.

[23]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[24]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[25]  Wan-Yu Deng,et al.  Cross-person activity recognition using reduced kernel extreme learning machine , 2014, Neural Networks.

[26]  Hongyi Li,et al.  An Incremental Learning Method Based on Probabilistic Neural Networks and Adjustable Fuzzy Clustering for Human Activity Recognition by Using Wearable Sensors , 2012, IEEE Transactions on Information Technology in Biomedicine.

[27]  Antônio de Pádua Braga,et al.  Novel Cost-Sensitive Approach to Improve the Multilayer Perceptron Performance on Imbalanced Data , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[28]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[29]  Narasimhan Sundararajan,et al.  A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks , 2006, IEEE Transactions on Neural Networks.

[30]  Chee Kheong Siew,et al.  Universal Approximation using Incremental Constructive Feedforward Networks with Random Hidden Nodes , 2006, IEEE Transactions on Neural Networks.

[31]  Alexandros Iosifidis,et al.  Minimum Class Variance Extreme Learning Machine for Human Action Recognition , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Yong Liu,et al.  Multiclass AdaBoost ELM and Its Application in LBP Based Face Recognition , 2015 .

[33]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[34]  Yanqing Zhang,et al.  SVMs Modeling for Highly Imbalanced Classification , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[35]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[37]  Guang-Zhong Yang,et al.  Sensor Placement for Activity Detection Using Wearable Accelerometers , 2010, 2010 International Conference on Body Sensor Networks.

[38]  Xiaodong Li,et al.  Multiple-kernel-learning-based extreme learning machine for classification design , 2014, Neural Computing and Applications.

[39]  Gang Wang,et al.  A novel face recognition method based on sub-pattern and tensor , 2011, Neurocomputing.

[40]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[41]  Guang-Bin Huang,et al.  Trends in extreme learning machines: A review , 2015, Neural Networks.

[42]  Danwei Wang,et al.  Sparse Extreme Learning Machine for Classification , 2014, IEEE Transactions on Cybernetics.