A Study of Accelerometer and Gyroscope Measurements in Physical Life-Log Activities Detection Systems

Nowadays, wearable technology can enhance physical human life-log routines by shifting goals from merely counting steps to tackling significant healthcare challenges. Such wearable technology modules have presented opportunities to acquire important information about human activities in real-life environments. The purpose of this paper is to report on recent developments and to project future advances regarding wearable sensor systems for the sustainable monitoring and recording of human life-logs. On the basis of this survey, we propose a model that is designed to retrieve better information during physical activities in indoor and outdoor environments in order to improve the quality of life and to reduce risks. This model uses a fusion of both statistical and non-statistical features for the recognition of different activity patterns using wearable inertial sensors, i.e., triaxial accelerometers, gyroscopes and magnetometers. These features include signal magnitude, positive/negative peaks and position direction to explore signal orientation changes, position differentiation, temporal variation and optimal changes among coordinates. These features are processed by a genetic algorithm for the selection and classification of inertial signals to learn and recognize abnormal human movement. Our model was experimentally evaluated on four benchmark datasets: Intelligent Media Wearable Smart Home Activities (IM-WSHA), a self-annotated physical activities dataset, Wireless Sensor Data Mining (WISDM) with different sporting patterns from an IM-SB dataset and an SMotion dataset with different physical activities. Experimental results show that the proposed feature extraction strategy outperformed others, achieving an improved recognition accuracy of 81.92%, 95.37%, 90.17%, 94.58%, respectively, when IM-WSHA, WISDM, IM-SB and SMotion datasets were applied.

[1]  Mi Zhang,et al.  Motion primitive-based human activity recognition using a bag-of-features approach , 2012, IHI '12.

[2]  Tae-Seong Kim,et al.  Human Activity Recognition via Recognized Body Parts of Human Depth Silhouettes for Residents Monitoring Services at Smart Home , 2013 .

[3]  Duoqian Miao,et al.  Influence of kernel clustering on an RBFN , 2019, CAAI Trans. Intell. Technol..

[4]  Ahmad Jalal,et al.  Vision-Based Human Activity Recognition System Using Depth Silhouettes: A Smart Home System for Monitoring the Residents , 2019, Journal of Electrical Engineering & Technology.

[5]  Anna M. Bianchi,et al.  User-Independent Recognition of Sports Activities From a Single Wrist-Worn Accelerometer: A Template-Matching-Based Approach , 2016, IEEE Transactions on Biomedical Engineering.

[6]  Ahmad Jalal,et al.  Wearable Sensor-Based Human Behavior Understanding and Recognition in Daily Life for Smart Environments , 2018, 2018 International Conference on Frontiers of Information Technology (FIT).

[7]  Mohamed Chetouani,et al.  Hilbert-Huang transform based physiological signals analysis for emotion recognition , 2009, 2009 IEEE International Symposium on Signal Processing and Information Technology (ISSPIT).

[8]  F. Bremond,et al.  A Multi-Sensor Approach for Activity Recognition in Older Patients , 2012 .

[9]  Manouchehr Shokri,et al.  A Review on the Artificial Neural Network Approach to Analysis and Prediction of Seismic Damage in Infrastructure , 2019, International Journal of Hydromechatronics.

[10]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[11]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[12]  José Víctor Rodríguez,et al.  An Autonomous Alarm System for Personal Safety Assurance of Intimate Partner Violence Survivors Based on Passive Continuous Monitoring through Biosensors , 2020, Symmetry.

[13]  Jiyoun Lim,et al.  Sensor Data Acquisition and Multimodal Sensor Fusion for Human Activity Recognition Using Deep Learning , 2019, Sensors.

[14]  Maria Mahmood,et al.  Students’ behavior mining in e-learning environment using cognitive processes with information technologies , 2019, Education and Information Technologies.

[15]  Majid Ali Khan Quaid,et al.  Wearable sensors based human behavioral pattern recognition using statistical features and reweighted genetic algorithm , 2019, Multimedia Tools and Applications.

[16]  Bala Srinivasan,et al.  Adaptive mobile activity recognition system with evolving data streams , 2015, Neurocomputing.

[17]  Lintai Wu,et al.  Three-stage network for age estimation , 2019, CAAI Trans. Intell. Technol..

[18]  Daijin Kim,et al.  A Depth Video Sensor-Based Life-Logging Human Activity Recognition System for Elderly Care in Smart Indoor Environments , 2014, Sensors.

[19]  S. Yaacob,et al.  Emotion recognition from electrocardiogram signals using Hilbert Huang Transform , 2012, 2012 IEEE Conference on Sustainable Utilization and Development in Engineering and Technology (STUDENT).

[20]  Travis Wiens,et al.  Engine Speed Reduction for Hydraulic Machinery Using Predictive Algorithms , 2019, International Journal of Hydromechatronics.

[21]  Andrey Ignatov,et al.  Real-time human activity recognition from accelerometer data using Convolutional Neural Networks , 2018, Appl. Soft Comput..

[22]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[23]  K. Shadan,et al.  Available online: , 2012 .

[24]  Jürgen Weber,et al.  Analytical analysis of single-stage pressure relief valves , 2019, International Journal of Hydromechatronics.

[25]  Didier Stricker,et al.  Confidence-based multiclass AdaBoost for physical activity monitoring , 2013, ISWC '13.

[26]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[27]  Kibum Kim,et al.  RGB-D Images for Object Segmentation, Localization and Recognition in Indoor Scenes using Feature Descriptor and Hough Voting , 2020, 2020 17th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[28]  Lei Liu,et al.  Human Daily Activity Recognition for Healthcare Using Wearable and Visual Sensing Data , 2016, 2016 IEEE International Conference on Healthcare Informatics (ICHI).

[29]  Eduardo Casilari-Pérez,et al.  A Study of the Use of Gyroscope Measurements in Wearable Fall Detection Systems , 2020, Symmetry.

[30]  Ahmad Jalal,et al.  A Triaxial Acceleration-based Human Motion Detection for Ambient Smart Home System , 2019, 2019 16th International Bhurban Conference on Applied Sciences and Technology (IBCAST).

[31]  Haibo Hu,et al.  Wearable Sensor-Based Human Activity Recognition Method with Multi-Features Extracted from Hilbert-Huang Transform , 2016, Sensors.

[32]  Teh Ying Wah,et al.  Data fusion and multiple classifier systems for human activity detection and health monitoring: Review and open research directions , 2019, Inf. Fusion.

[33]  Kim-Kwang Raymond Choo,et al.  Imaging and fusing time series for wearable sensor-based human activity recognition , 2020, Inf. Fusion.

[34]  Yan Wang,et al.  A review of sensor selection, sensor devices and sensor deployment for wearable sensor-based human activity recognition systems , 2016, 2016 10th International Conference on Software, Knowledge, Information Management & Applications (SKIMA).

[35]  Ureerat Suksawatchon,et al.  Impersonal smartphone-based activity recognition using the accelerometer sensory data , 2017, 2017 2nd International Conference on Information Technology (INCIT).

[36]  Waleed Ejaz,et al.  ADLAuth: Passive Authentication Based on Activity of Daily Living Using Heterogeneous Sensing in Smart Cities , 2019, Sensors.

[37]  Xianbin Wang,et al.  Human activity detection based on multiple smart phone sensors and machine learning algorithms , 2015, 2015 IEEE 19th International Conference on Computer Supported Cooperative Work in Design (CSCWD).

[38]  Athanasios V. Vasilakos,et al.  GCHAR: An efficient Group-based Context - aware human activity recognition on smartphone , 2017, J. Parallel Distributed Comput..

[39]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[40]  Maria Mahmood,et al.  WHITE STAG model: wise human interaction tracking and estimation (WHITE) using spatio-temporal and angular-geometric (STAG) descriptors , 2019, Multimedia Tools and Applications.

[41]  Tahmina Zebin,et al.  Human activity recognition with inertial sensors using a deep learning approach , 2016, 2016 IEEE SENSORS.

[42]  Luc Cluitmans,et al.  Advancing from offline to online activity recognition with wearable sensors , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  Tahmina Zebin,et al.  Evaluation of supervised classification algorithms for human activity recognition with inertial sensors , 2017, 2017 IEEE SENSORS.

[44]  P. Bonato,et al.  Wearable sensors/systems and their impact on biomedical engineering , 2003, IEEE Engineering in Medicine and Biology Magazine.

[45]  Ahmad Jalal,et al.  Robust Spatio-Temporal Features for Human Interaction Recognition Via Artificial Neural Network , 2018, 2018 International Conference on Frontiers of Information Technology (FIT).

[46]  Vasileios Megalooikonomou,et al.  Human motion detection in daily activity tasks using wearable sensors , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[47]  Adnan Nadeem,et al.  A dataset build using wearable inertial measurement and ECG sensors for activity recognition, fall detection and basic heart anomaly detection system , 2019, Data in brief.

[48]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[49]  Chen Wu,et al.  Multiview activity recognition in smart homes with spatio-temporal features , 2010, ICDSC '10.

[50]  A. Goris,et al.  Detection of type, duration, and intensity of physical activity using an accelerometer. , 2009, Medicine and science in sports and exercise.

[51]  Lifeng Li,et al.  Adaptive multiple classifiers fusion for inertial sensor based human activity recognition , 2018, Cluster Computing.

[52]  Tao Liu,et al.  Gait Analysis Using Wearable Sensors , 2012, Sensors.

[53]  Laura Gastaldi,et al.  Human Activity Recognition by Wearable Sensors : Comparison of different classifiers for real-time applications , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[54]  Tomasz Hachaj Improving Human Motion Classification by Applying Bagging and Symmetry to PCA-Based Features , 2019, Symmetry.

[55]  Seba Susan,et al.  New shape descriptor in the context of edge continuity , 2019, CAAI Trans. Intell. Technol..

[56]  Dong-Seong Kim,et al.  Detecting Complex 3D Human Motions with Body Model Low-Rank Representation for Real-Time Smart Activity Monitoring System , 2018, KSII Trans. Internet Inf. Syst..

[57]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[58]  Marek B. Zaremba,et al.  Wearable Sensor Data Classification for Human Activity Recognition Based on an Iterative Learning Framework † , 2017, Sensors.

[59]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[60]  T. Ganesan,et al.  Classification of human activity based on smartphone inertial sensor using support vector machine , 2017, 2017 IEEE 3rd International Symposium in Robotics and Manufacturing Automation (ROMA).

[61]  Eliasz Kantoch,et al.  Human activity recognition for physical rehabilitation using wearable sensors fusion and artificial neural networks , 2017, 2017 Computing in Cardiology (CinC).

[62]  François Brémond,et al.  Monitoring Activities of Daily Living (ADLs) of Elderly Based on 3D Key Human Postures , 2009, ICVW.