A Comprehensive Study of Smartphone-Based Indoor Activity Recognition via Xgboost

Recently, multi-floor indoor positioning has become increasingly interesting for researchers, in which accurate recognition of indoor activities is critical for the detection of floor changes and the improvement of positioning accuracy according to indoor landmarks. However, we have not found a comprehensive study for recognizing indoor activities related to multi-floor indoor positioning based on a robust machine learning algorithm. In this work, we propose a framework for recognizing five indoor activities, i.e., walking, stillness, stair climbing, escalator, or elevator taking. In this framework, we investigate the relevant sensors and features to improve the recognition accuracy of these activities, especially some specific features in the frequency domain and wavelet domain. We propose to utilize a promising tree-based ensemble learning classifier, XGBoost, to recognize these activities. Based on our dataset created by 40 volunteers, we provide a comprehensive analysis of the proposed framework for indoor activity recognition. Considering both accuracy and computational cost, the XGBoost-based indoor activity recognition algorithm outperforms the other ensemble learning classifiers and single classifiers, and the average recognition F-score of XGBoost reaches 84.41%. In addition, our introduced specific features in the frequency domain and wavelet domain can significantly improve the recognition accuracy. Moreover, we use a publicly available dataset to verify our proposed framework and XGBoost classifier reaches 84.19% that outperforms the other classifiers.

[1]  Paul J. M. Havinga,et al.  Complex Human Activity Recognition Using Smartphone and Wrist-Worn Motion Sensors , 2016, Sensors.

[2]  Vivek Kanhangad,et al.  Human Activity Classification in Smartphones Using Accelerometer and Gyroscope Sensors , 2018, IEEE Sensors Journal.

[3]  Weng-Keen Wong,et al.  Physical Activity Recognition from Accelerometer Data Using a Multi-Scale Ensemble Method , 2013, IAAI.

[4]  Mun Choon Chan,et al.  iMap: Automatic inference of indoor semantics exploiting opportunistic smartphone sensing , 2015, 2015 12th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[5]  Özlem Durmaz Incel,et al.  User, device and orientation independent human activity recognition on mobile phones: challenges and a proposal , 2013, UbiComp.

[6]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[7]  Heinrich C. Mayr,et al.  A windowing approach for activity recognition in sensor data streams , 2016, 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN).

[8]  Wei Tu,et al.  ALIMC: Activity Landmark-Based Indoor Mapping via Crowdsourcing , 2015, IEEE Transactions on Intelligent Transportation Systems.

[9]  Gang Zhou,et al.  RadioSense: Exploiting Wireless Communication Patterns for Body Sensor Network Activity Recognition , 2012, 2012 IEEE 33rd Real-Time Systems Symposium.

[10]  Md. Atiqur Rahman Ahad,et al.  Feature Extraction, Performance Analysis and System Design Using the DU Mobility Dataset , 2018, IEEE Access.

[11]  Surapa Thiemjarus,et al.  Accurate Activity Recognition Using a Mobile Phone Regardless of Device Orientation and Location , 2011, 2011 International Conference on Body Sensor Networks.

[12]  Yunhao Liu,et al.  Pervasive Floorplan Generation Based on Only Inertial Sensing: Feasibility, Design, and Implementation , 2017, IEEE Journal on Selected Areas in Communications.

[13]  Wei Zhang,et al.  Activity Recognition Based on Smartphone and Dual-Tree Complex Wavelet Transform , 2015, 2015 8th International Symposium on Computational Intelligence and Design (ISCID).

[14]  Tahmina Zebin,et al.  Evaluation of supervised classification algorithms for human activity recognition with inertial sensors , 2017, 2017 IEEE SENSORS.

[15]  Davide Anguita,et al.  Human Activity Recognition on Smartphones Using a Multiclass Hardware-Friendly Support Vector Machine , 2012, IWAAL.

[16]  Bingsheng He,et al.  Efficient Gradient Boosted Decision Tree Training on GPUs , 2018, 2018 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[17]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Majid Sarrafzadeh,et al.  Robust Human Activity and Sensor Location Corecognition via Sparse Signal Representation , 2012, IEEE Transactions on Biomedical Engineering.

[19]  Hao Hu,et al.  Learning Compact Features for Human Activity Recognition Via Probabilistic First-Take-All , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Lama Nachman,et al.  Mago: Mode of Transport Inference Using the Hall-Effect Magnetic Sensor and Accelerometer , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[21]  Mun Choon Chan,et al.  MPiLoc: Self-Calibrating Multi-Floor Indoor Localization Exploiting Participatory Sensing , 2018, IEEE Transactions on Mobile Computing.

[22]  Thomas George,et al.  An effective approach for human activity recognition on smartphone , 2015, 2015 IEEE International Conference on Engineering and Technology (ICETECH).

[23]  Mohan M. Trivedi,et al.  3-D Posture and Gesture Recognition for Interactivity in Smart Spaces , 2012, IEEE Transactions on Industrial Informatics.

[24]  Jianming Wei,et al.  A robust floor localization method using inertial and barometer measurements , 2017, 2017 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[25]  Jie Tan,et al.  Identification of Power Quality Disturbance Sources using Gradient Boosting Decision Tree , 2018, 2018 Chinese Automation Congress (CAC).

[26]  Meng Li,et al.  A Random Forest-based ensemble method for activity recognition , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[27]  Jenq-Neng Hwang,et al.  A Review on Video-Based Human Activity Recognition , 2013, Comput..

[28]  Kamiar Aminian,et al.  Mobility assessment in older people: new possibilities and challenges , 2007, European journal of ageing.

[29]  Kibong Song,et al.  Human activity recognition using wearable accelerometer sensors , 2016, 2016 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia).

[30]  Lihua Xie,et al.  A Novel Ensemble ELM for Human Activity Recognition Using Smartphone Sensors , 2019, IEEE Transactions on Industrial Informatics.

[31]  Rainer Stiefelhagen,et al.  CNN-based sensor fusion techniques for multimodal human activity recognition , 2017, SEMWEB.

[32]  Susanna Kaiser,et al.  Classifying Elevators and Escalators in 3D Pedestrian Indoor Navigation Using Foot-Mounted Sensors , 2018, 2018 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[33]  Zan Li,et al.  Fine-grained indoor tracking by fusing inertial sensor and physical layer information in WLANs , 2016, 2016 IEEE International Conference on Communications (ICC).

[34]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[35]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.

[36]  Gert R. G. Lanckriet,et al.  Recognizing Detailed Human Context in the Wild from Smartphones and Smartwatches , 2016, IEEE Pervasive Computing.

[37]  Yu-Liang Hsu,et al.  Human Daily and Sport Activity Recognition Using a Wearable Inertial Sensor Network , 2018, IEEE Access.

[38]  Rubén San-Segundo-Hernández,et al.  Human activity monitoring based on hidden Markov models using a smartphone , 2016, IEEE Instrumentation & Measurement Magazine.

[39]  Ziad Salam Patrous Evaluating XGBoost for User Classification by using Behavioral Features Extracted from Smartphone Sensors , 2018 .

[40]  Wen-Chih Peng,et al.  A study on multiple wearable sensors for activity recognition , 2017, 2017 IEEE Conference on Dependable and Secure Computing.

[41]  Bashir I. Morshed,et al.  Fully-Automated Human Activity Recognition with Transition Awareness from Wearable Sensor Data for mHealth , 2018, 2018 IEEE International Conference on Electro/Information Technology (EIT).

[42]  Shenghui Zhao,et al.  A Comparative Study on Human Activity Recognition Using Inertial Sensors in a Smartphone , 2016, IEEE Sensors Journal.

[43]  Nabil Zerrouki,et al.  Vision-Based Human Action Classification Using Adaptive Boosting Algorithm , 2018, IEEE Sensors Journal.

[44]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[45]  Alejandro Baldominos Gómez,et al.  A Comparison Study of Classifier Algorithms for Cross-Person Physical Activity Recognition , 2016, Sensors.

[46]  Yufei Chen,et al.  Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition , 2017, IEEE Access.

[47]  S. Anitha,et al.  Analysis of filtering and novel technique for noise removal in MRI and CT images , 2017, 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT).

[48]  Zan Li,et al.  Automatic Construction of Radio Maps by Crowdsourcing PDR Traces for Indoor Positioning , 2018, 2018 IEEE International Conference on Communications (ICC).

[49]  Lina Yao,et al.  Multi-Person Brain Activity Recognition via Comprehensive EEG Signal Analysis , 2017, MobiQuitous.

[50]  Feng Zhao,et al.  A reliable and accurate indoor localization method using phone inertial sensors , 2012, UbiComp.