Self-Gated Recurrent Neural Networks for Human Activity Recognition on Wearable Devices

This paper develops a self-gated recurrent neural network (SGRNN), and applies it to human activity recognition (HAR), using time-series signals collected from embedded sensors of wearable devices. Recurrent neural networks (RNNs) are very powerful for time-series signal analysis. Especially, by integrating gates into recurrent units, gated RNNs such as LSTM and GRU are more complexity, and do not suffer from the vanishing gradient problem, so can learn very long-term dependencies. However, for use on wearable devices, RNNs must be simplified to reduce resource consumption, including memory usage and computational cost. The proposed model is approximately the same size and burdensome computation as that of a standard RNN, but exhibits explicit properties of the gating mechanism, so it is unaffected by the problem of vanishing gradients. Experimental results on the HAR problem not only demonstrate that the accuracy of our model is superior to that of the standard RNN, and is comparable with that of LSTM and GRU, but the model is low in resource consumption.

[1]  Le Song,et al.  Recurrent Hidden Semi-Markov Model , 2017, ICLR.

[2]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ying Zhang,et al.  On Multiplicative Integration with Recurrent Neural Networks , 2016, NIPS.

[4]  Jia-Ching Wang,et al.  Transportation Mode Detection on Mobile Devices Using Recurrent Nets , 2016, ACM Multimedia.

[5]  Hwee Pink Tan,et al.  Deep Activity Recognition Models with Triaxial Accelerometers , 2015, AAAI Workshop: Artificial Intelligence Applied to Assistive Technologies and Smart Environments.

[6]  Takeshi Nishida,et al.  Deep recurrent neural network for mobile human activity recognition with high throughput , 2017, Artificial Life and Robotics.

[7]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[8]  Wojciech Zaremba,et al.  An Empirical Exploration of Recurrent Network Architectures , 2015, ICML.

[9]  Seungjin Choi,et al.  Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[10]  Patrick Olivier,et al.  Feature Learning for Activity Recognition in Ubiquitous Computing , 2011, IJCAI.

[11]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[13]  Bernt Schiele,et al.  Analyzing features for activity recognition , 2005, sOc-EUSAI '05.

[14]  Mi Zhang,et al.  A feature selection-based framework for human activity recognition using wearable multimodal sensors , 2011, BODYNETS.

[15]  Diogo R. Ferreira,et al.  Preprocessing techniques for context recognition from accelerometer data , 2010, Personal and Ubiquitous Computing.

[16]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[17]  Yuan Gao,et al.  Deep Gate Recurrent Neural Network , 2016, ACML.

[18]  Jiang Zhu,et al.  Mobile Lifelogger - Recording, Indexing, and Understanding a Mobile User's Life , 2010, MobiCASE.

[19]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[20]  Guang-Zhong Yang,et al.  Deep learning for human activity recognition: A resource efficient implementation on low-power devices , 2016, 2016 IEEE 13th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[21]  Geoffrey E. Hinton,et al.  A Simple Way to Initialize Recurrent Networks of Rectified Linear Units , 2015, ArXiv.

[22]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[23]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[24]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[25]  Geoffrey E. Hinton,et al.  On rectified linear units for speech processing , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Chih-Jen Lin,et al.  Big Data Small Footprint: The Design of A Low-Power Classifier for Detecting Transportation Modes , 2014, Proc. VLDB Endow..

[27]  Jiang Zhu,et al.  MobiSens: A Versatile Mobile Sensing Platform for Real-World Applications , 2013, Mob. Networks Appl..

[28]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[29]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[30]  Luca Benini,et al.  Activity Recognition from On-Body Sensors: Accuracy-Power Trade-Off by Dynamic Sensor Selection , 2008, EWSN.

[31]  Ying Zhang,et al.  SensCare: Semi-automatic Activity Summarization System for Elderly Care , 2011, MobiCASE.

[32]  Zhaozheng Yin,et al.  Human Activity Recognition Using Wearable Sensors by Deep Convolutional Neural Networks , 2015, ACM Multimedia.