Wearable Inertial Sensors for Daily Activity Analysis Based on Adam Optimization and the Maximum Entropy Markov Model

Advancements in wearable sensors technologies provide prominent effects in the daily life activities of humans. These wearable sensors are gaining more awareness in healthcare for the elderly to ensure their independent living and to improve their comfort. In this paper, we present a human activity recognition model that acquires signal data from motion node sensors including inertial sensors, i.e., gyroscopes and accelerometers. First, the inertial data is processed via multiple filters such as Savitzky–Golay, median and hampel filters to examine lower/upper cutoff frequency behaviors. Second, it extracts a multifused model for statistical, wavelet and binary features to maximize the occurrence of optimal feature values. Then, adaptive moment estimation (Adam) and AdaDelta are introduced in a feature optimization phase to adopt learning rate patterns. These optimized patterns are further processed by the maximum entropy Markov model (MEMM) for empirical expectation and highest entropy, which measure signal variances for outperformed accuracy results. Our model was experimentally evaluated on University of Southern California Human Activity Dataset (USC-HAD) as a benchmark dataset and on an Intelligent Mediasporting behavior (IMSB), which is a new self-annotated sports dataset. For evaluation, we used the “leave-one-out” cross validation scheme and the results outperformed existing well-known statistical state-of-the-art methods by achieving an improved recognition accuracy of 91.25%, 93.66% and 90.91% when compared with USC-HAD, IMSB, and Mhealth datasets, respectively. The proposed system should be applicable to man–machine interface domains, such as health exercises, robot learning, interactive games and pattern-based surveillance.

[1]  Duoqian Miao,et al.  Influence of kernel clustering on an RBFN , 2019, CAAI Trans. Intell. Technol..

[2]  Zrar Kh. Abdul,et al.  A New Feature Extraction Technique Based on 1D Local Binary Pattern for Gear Fault Detection , 2016 .

[3]  Subhas Chandra Mukhopadhyay,et al.  Wearable Electronics Sensors: Current Status and Future Opportunities , 2015 .

[4]  Kibum Kim,et al.  A Wrist Worn Acceleration Based Human Motion Analysis and Classification for Ambient Smart Home System , 2019, Journal of Electrical Engineering & Technology.

[5]  Ying Wah Teh,et al.  Multi-sensor fusion based on multiple classifier systems for human activity identification , 2019, Human-centric Computing and Information Sciences.

[6]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[7]  Md. Rashedul Islam,et al.  Enhanced Human Activity Recognition Based on Smartphone Sensor Data Using Hybrid Feature Selection Model , 2020, Sensors.

[8]  Seba Susan,et al.  New shape descriptor in the context of edge continuity , 2019, CAAI Trans. Intell. Technol..

[9]  Jake K. Aggarwal,et al.  Human Activity Recognition , 2005, PReMI.

[10]  Athanasios V. Vasilakos,et al.  GCHAR: An efficient Group-based Context - aware human activity recognition on smartphone , 2017, J. Parallel Distributed Comput..

[11]  Mi Zhang,et al.  USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors , 2012, UbiComp.

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Caifeng Shan,et al.  Sensors, vision and networks: From video surveillance to activity recognition and health monitoring , 2019, J. Ambient Intell. Smart Environ..

[14]  Othman O. Khalifa,et al.  Automated daily human activity recognition for video surveillance using neural network , 2017, 2017 IEEE 4th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA).

[15]  Byeong-Seok Shin,et al.  Sustainable Wearables: Wearable Technology for Enhancing the Quality of Human Life , 2016 .

[16]  Othman O. Khalifa,et al.  Human activity recognition for video surveillance using sequences of postures , 2014, The Third International Conference on e-Technologies and Networks for Development (ICeND2014).

[17]  Ignacio Rojas,et al.  Design, implementation and validation of a novel open framework for agile development of mobile health applications , 2015, BioMedical Engineering OnLine.

[18]  Manouchehr Shokri,et al.  A Review on the Artificial Neural Network Approach to Analysis and Prediction of Seismic Damage in Infrastructure , 2019, International Journal of Hydromechatronics.

[19]  L. Koehl,et al.  Wearable Sensor Data Based Human Activity Recognition using Machine Learning: A new approach , 2019, ArXiv.

[20]  Travis Wiens,et al.  Engine Speed Reduction for Hydraulic Machinery Using Predictive Algorithms , 2019, International Journal of Hydromechatronics.

[21]  F. Ichikawa,et al.  Where's The Phone? A Study of Mobile Phone Location in Public Spaces , 2005, 2005 2nd Asia Pacific Conference on Mobile Technology, Applications and Systems.

[22]  Xi Chen,et al.  Activity Analysis, Summarization, and Visualization for Indoor Human Activity Monitoring , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Subhas Chandra Mukhopadhyay,et al.  Wearable Sensors for Human Activity Monitoring: A Review , 2015, IEEE Sensors Journal.

[24]  Lintai Wu,et al.  Three-stage network for age estimation , 2019, CAAI Trans. Intell. Technol..

[25]  Daijin Kim,et al.  Robust human activity recognition from depth video using spatiotemporal multi-fused features , 2017, Pattern Recognit..

[26]  Marco Morana,et al.  Human Activity Recognition Process Using 3-D Posture Data , 2015, IEEE Transactions on Human-Machine Systems.

[27]  Katarzyna Radecka,et al.  A Comprehensive Analysis on Wearable Acceleration Sensors in Human Activity Recognition , 2017, Sensors.

[28]  K. Shadan,et al.  Available online: , 2012 .

[29]  Jürgen Weber,et al.  Analytical analysis of single-stage pressure relief valves , 2019, International Journal of Hydromechatronics.

[30]  Diane J. Cook,et al.  Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments , 2016, J. Ambient Intell. Humaniz. Comput..

[31]  Aswin Sivakumar,et al.  Geometry Aware Compressive Analysis of Human Activities : Application in a Smart Phone Platform , 2014 .

[32]  Subhas Mukhopadhyay,et al.  Smart Sensing System for Human Emotion and Behaviour Recognition , 2012, PerMIn.

[33]  Tahmina Zebin,et al.  Human activity recognition with inertial sensors using a deep learning approach , 2016, 2016 IEEE SENSORS.

[34]  Ling Chen,et al.  Wearable sensor based multimodal human activity recognition exploiting the diversity of classifier ensemble , 2016, UbiComp.

[35]  S. Domnic,et al.  Walsh–Hadamard Transform Kernel-Based Feature Vector for Shot Boundary Detection , 2014, IEEE Transactions on Image Processing.

[36]  Fadi Al Machot,et al.  A review on applications of activity recognition systems with regard to performance and evaluation , 2016, Int. J. Distributed Sens. Networks.

[37]  Fuad A. Ghaleb,et al.  Two-stage motion artefact reduction algorithm for electrocardiogram using weighted adaptive noise cancelling and recursive Hampel filter , 2018, PloS one.

[38]  Weihua Sheng,et al.  Multi-sensor fusion for human daily activity recognition in robot-assisted living , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).