A Novel Ensemble ELM for Human Activity Recognition Using Smartphone Sensors

Human activity recognition plays a unique role in many important applications, including ubiquitous computing, health-care services, and smart buildings. Due to the nonintrusive property of smartphones, smartphone sensors are widely used for the identification of human activities. Since the signals of smartphone sensors are quite noisy, feature engineering will be performed to extract more discriminant representations. Then, various machine learning algorithms can be employed to recognize different human activities. Extreme learning machine (ELM) has been shown to be effective in classification tasks with extremely fast learning speed. Due to its randomness property, it is naturally suitable for ensemble learning. In this paper, we propose a novel ensemble ELM algorithm for human activity recognition using smartphone sensors. Gaussian random projection is employed to initialize the input weights of base ELMs. By doing this, more diversities can be generated to boost the performance of ensemble learning. Real experimental data has been applied to evaluate the performance of our proposed approach. We also conduct a comparison of the proposed approach with some state-of-the-art approaches in the literature. The experimental results indicate that our proposed ensemble ELM approach outperforms these approaches and can achieve recognition accuracies of $\text{97.35}\%$ and $\text{98.88}\%$ on two datasets.

[1]  Rajib Rana,et al.  Novel activity classification and occupancy estimation methods for intelligent HVAC (heating, ventilation and air conditioning) systems , 2015 .

[2]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[3]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[4]  Shusen Wang,et al.  A Practical Guide to Randomized Matrix Computations with MATLAB Implementations , 2015, ArXiv.

[5]  Hongming Zhou,et al.  Extreme Learning Machine for Regression and Multiclass Classification , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Zhenghua Chen,et al.  A fusion framework for occupancy estimation in office buildings based on environmental sensor data , 2016 .

[7]  Taher Niknam,et al.  Probabilistic Forecasting of Hourly Electricity Price by Generalization of ELM for Usage in Improved Wavelet Neural Network , 2017, IEEE Transactions on Industrial Informatics.

[8]  Hassan Ghasemzadeh,et al.  Physical Movement Monitoring Using Body Sensor Networks: A Phonological Approach to Construct Spatial Decision Trees , 2011, IEEE Transactions on Industrial Informatics.

[9]  Xiaohui Xie,et al.  Co-Occurrence Feature Learning for Skeleton Based Action Recognition Using Regularized Deep LSTM Networks , 2016, AAAI.

[10]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[11]  Sung-Bae Cho,et al.  Human activity recognition using smartphone sensors with two-stage continuous hidden Markov models , 2014, 2014 10th International Conference on Natural Computation (ICNC).

[12]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.

[13]  Zhelong Wang,et al.  Mixed-kernel based weighted extreme learning machine for inertial sensor based human activity recognition with imbalanced dataset , 2016, Neurocomputing.

[14]  Hua Li,et al.  Indoor occupancy estimation from carbon dioxide concentration , 2016, ArXiv.

[15]  Jing Lv,et al.  Recognizing Parkinsonian Gait Pattern by Exploiting Fine-Grained Movement Function Features , 2016, ACM Trans. Intell. Syst. Technol..

[16]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[17]  Chee Peng Lim,et al.  A hybrid FMM-CART model for human activity recognition , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Chee Kheong Siew,et al.  Extreme learning machine: Theory and applications , 2006, Neurocomputing.

[20]  Marti A. Hearst Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[21]  Yu Gu,et al.  PAWS: Passive Human Activity Recognition Based on WiFi Ambient Signals , 2016, IEEE Internet of Things Journal.

[22]  Thomas G. Dietterich An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[23]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.

[24]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[25]  Majid Sarrafzadeh,et al.  Designing a Robust Activity Recognition Framework for Health and Exergaming Using Wearable Sensors , 2014, IEEE Journal of Biomedical and Health Informatics.

[26]  Kezhi Mao,et al.  Semi-Random Projection for Dimensionality Reduction and Extreme Learning Machine in High-Dimensional Space , 2015, IEEE Computational Intelligence Magazine.

[27]  Chrisina Jayne,et al.  Evaluation of hyperbox neural network learning for classification , 2014, Neurocomputing.

[28]  Cagatay Catal,et al.  On the use of ensemble of classifiers for accelerometer-based activity recognition , 2015, Appl. Soft Comput..

[29]  Bo Ding,et al.  Unsupervised Feature Learning for Human Activity Recognition Using Smartphone Sensors , 2014, MIKE.

[30]  Sung-Bae Cho,et al.  Deep Convolutional Neural Networks for Human Activity Recognition with Smartphone Sensors , 2015, ICONIP.

[31]  Hiroshi Motoda,et al.  Feature Extraction, Construction and Selection: A Data Mining Perspective , 1998 .

[32]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.