Building robust models for Human Activity Recognition from raw accelerometers data using Gated Recurrent Units and Long Short Term Memory Neural Networks

Human Activity Recognition (HAR) is a growing field of research in biomedical engineering and it has many potential applications in the treatment and prevention of several diseases. Due to the recent advancement in technology, devices that collect position and orientation measurements (e.g. accelerometers and gyroscopes) are becoming ubiquitous. These measurements can then be used to train machine learning models for HAR. In this research, we propose one recurrent neural network architecture and a data augmentation approach for building robust and accurate models for HAR. We compared models with Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) layers. The proposed data augmentation approach was used to make the models robust to the cases where one or more sensors are missing. In this empirical study, we could also understand some relations between the ideal locations of the sensors in the participants and the types of activities performed. The proposed approaches were tested in the GOTOv dataset from a study which involved 35 participants performing 16 sedentary, ambulatory and lifestyle activities in a semi-structured environment. The results presented, clearly show that the models are able to detect these activities in a robust way.

[1]  E. A. Etchu Security and Privacy in Sensor Networks , 2010 .

[2]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[3]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[4]  Xiao-Li Meng,et al.  The Art of Data Augmentation , 2001 .

[5]  Shih-Chii Liu,et al.  Overcoming the vanishing gradient problem in plain recurrent networks , 2018, ArXiv.

[6]  Petia Radeva,et al.  Human Activity Recognition from Accelerometer Data Using a Wearable Device , 2011, IbPRIA.

[7]  Takafumi Koseki,et al.  Investigation of Feature Extraction for Unsupervised Learning in Human Activity Detection , 2013 .

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Jaeyoung Yang,et al.  Activity Recognition Based on RFID Object Usage for Smart Mobile Devices , 2011, Journal of Computer Science and Technology.

[10]  Majid Sarrafzadeh,et al.  Designing a Robust Activity Recognition Framework for Health and Exergaming Using Wearable Sensors , 2014, IEEE Journal of Biomedical and Health Informatics.

[11]  H. Pijl,et al.  Human longevity is characterised by high thyroid stimulating hormone secretion without altered energy metabolism , 2015, Scientific Reports.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[14]  Lau Bee Theng,et al.  Human activity recognition: A review , 2014, 2014 IEEE International Conference on Control System, Computing and Engineering (ICCSCE 2014).

[15]  Yoshua Bengio,et al.  Gated Feedback Recurrent Neural Networks , 2015, ICML.

[16]  Jun-Da Huang Kinerehab: a kinect-based system for physical rehabilitation: a pilot study for young adults with motor disabilities , 2011, ASSETS '11.

[17]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[18]  Jungang Xu,et al.  A Recurrent Neural Network Language Model Based on Word Embedding , 2018, APWeb/WAIM Workshops.

[19]  Alexandros André Chaaraoui,et al.  Evolutionary joint selection to improve human action recognition with RGB-D devices , 2014, Expert Syst. Appl..

[20]  Héctor Pomares,et al.  Daily living activity recognition based on statistical feature quality group selection , 2012, Expert Syst. Appl..

[21]  Arvind Kumar Shekar,et al.  Building robust prediction models for defective sensor data using Artificial Neural Networks , 2019, SOCO.

[22]  Edward Sazonov,et al.  Monitoring of Posture Allocations and Activities by a Shoe-Based Wearable Sensor , 2011, IEEE Transactions on Biomedical Engineering.

[23]  Michael Catt,et al.  Effects of a Web-Based Intervention on Physical Activity and Metabolism in Older Adults: Randomized Controlled Trial , 2013, Journal of medical Internet research.

[24]  Shin'ichi Satoh,et al.  Robust Recognition of Specific Human Behaviors in Crowded Surveillance Video Sequences , 2010, EURASIP J. Adv. Signal Process..

[25]  Chiyoun Park,et al.  Accelerating Recurrent Neural Network Language Model Based Online Speech Recognition System , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Demetris Stathakis,et al.  How many hidden layers and nodes? , 2009 .

[27]  Bastian Leibe,et al.  Lying Pose Recognition for Elderly Fall Detection , 2011, Robotics: Science and Systems.

[28]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[29]  Sérgio B. Volchan,et al.  What Is a Random Sequence? , 2002, Am. Math. Mon..

[30]  D. Warburton,et al.  Health benefits of physical activity: the evidence , 2006, Canadian Medical Association Journal.

[31]  E. Feskens,et al.  Metabolic effects of a 13-weeks lifestyle intervention in older adults: The Growing Old Together Study , 2016, Aging.