Human Activity Recognition from Body Sensor Data using Deep Learning

In recent years, human activity recognition from body sensor data or wearable sensor data has become a considerable research attention from academia and health industry. This research can be useful for various e-health applications such as monitoring elderly and physical impaired people at Smart home to improve their rehabilitation processes. However, it is not easy to accurately and automatically recognize physical human activity through wearable sensors due to the complexity and variety of body activities. In this paper, we address the human activity recognition problem as a classification problem using wearable body sensor data. In particular, we propose to utilize a Deep Belief Network (DBN) model for successful human activity recognition. First, we extract the important initial features from the raw body sensor data. Then, a kernel principal component analysis (KPCA) and linear discriminant analysis (LDA) are performed to further process the features and make them more robust to be useful for fast activity recognition. Finally, the DBN is trained by these features. Various experiments were performed on a real-world wearable sensor dataset to verify the effectiveness of the deep learning algorithm. The results show that the proposed DBN outperformed other algorithms and achieves satisfactory activity recognition performance.

[1]  Anthony G. Cohn,et al.  Egocentric Activity Monitoring and Recovery , 2012, ACCV.

[2]  Reinhold Haux,et al.  Assessing elderly persons' fall risk using spectral analysis on accelerometric data - a clinical evaluation study , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Giancarlo Fortino,et al.  A facial expression recognition system using robust face features from depth videos and deep learning , 2017, Comput. Electr. Eng..

[4]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[5]  Lei Gao,et al.  A system for activity recognition using multi-sensor fusion , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Paul J. M. Havinga,et al.  Activity Recognition Using Inertial Sensing for Healthcare, Wellbeing and Sports Applications: A Survey , 2010, ARCS Workshops.

[7]  Tae-Seong Kim,et al.  A Triaxial Accelerometer-Based Physical-Activity Recognition via Augmented-Signal Features and a Hierarchical Recognizer , 2010, IEEE Transactions on Information Technology in Biomedicine.

[8]  Bernt Schiele,et al.  A tutorial on human activity recognition using body-worn inertial sensors , 2014, CSUR.

[9]  S. K. Tasoulis,et al.  Statistical data mining of streaming motion data for activity and fall recognition in assistive environments , 2013, Neurocomputing.

[10]  Chao Gao,et al.  Recognition of human activities with wearable sensors , 2012, EURASIP J. Adv. Signal Process..

[11]  Paul Lukowicz,et al.  Wearable sensing to annotate meeting recordings , 2002, Proceedings. Sixth International Symposium on Wearable Computers,.

[12]  Rafik A. Goubran,et al.  Privacy versus autonomy: A tradeoff model for smart home monitoring technologies , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Serena Yeung,et al.  Predicting Mode of Transport from iPhone Accelerometer Data , 2012 .

[14]  Brian Patrick Clarkson,et al.  Life patterns : structure from wearable sensors , 2002 .

[15]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[16]  Ronald Poppe,et al.  A survey on vision-based human action recognition , 2010, Image Vis. Comput..

[17]  Radha Poovendran,et al.  Human activity recognition for video surveillance , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[18]  Guang-Zhong Yang,et al.  A Deep Learning Approach to on-Node Sensor Data Analytics for Mobile or Wearable Devices , 2017, IEEE Journal of Biomedical and Health Informatics.

[19]  Daniele Giansanti,et al.  New neural network classifier of fall-risk based on the Mahalanobis distance and kinematic parameters assessed by a wearable device , 2008, Physiological measurement.

[20]  Paul Lukowicz,et al.  Recognizing and Discovering Human Actions from On-Body Sensor Data , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[21]  Yuzhe Liu,et al.  Detection of Salmonella Typhimurium on Spinach Using Phage-Based Magnetoelastic Biosensors , 2017, Sensors.

[22]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[23]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[24]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[25]  Yufei Chen,et al.  Performance Analysis of Smartphone-Sensor Behavior for Human Activity Recognition , 2017, IEEE Access.

[26]  Jeen-Shing Wang,et al.  Using acceleration measurements for activity recognition: An effective learning algorithm for constructing neural classifiers , 2008, Pattern Recognit. Lett..

[27]  Thomas Plötz,et al.  Deep, Convolutional, and Recurrent Models for Human Activity Recognition Using Wearables , 2016, IJCAI.

[28]  Nigel H. Lovell,et al.  A wearable triaxial accelerometry system for longitudinal assessment of falls risk , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[29]  Mario Cannataro,et al.  Protein-to-protein interactions: Technologies, databases, and algorithms , 2010, CSUR.

[30]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[31]  Andrew T. Campbell,et al.  From Smart to Cognitive Phones , 2012, IEEE Pervasive Computing.

[32]  Senem Velipasalar,et al.  A Survey on Activity Detection and Classification Using Wearable Sensors , 2017, IEEE Sensors Journal.

[33]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[34]  Ahmad Almogren,et al.  A robust human activity recognition system using smartphone sensors and deep learning , 2018, Future Gener. Comput. Syst..

[35]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[36]  H. M. Ebied Feature extraction using PCA and Kernel-PCA for face recognition , 2012, 2012 8th International Conference on Informatics and Systems (INFOS).

[37]  Tahmina Zebin,et al.  Human activity recognition with inertial sensors using a deep learning approach , 2016, 2016 IEEE SENSORS.

[38]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[39]  Seungjin Choi,et al.  Multi-modal Convolutional Neural Networks for Activity Recognition , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[40]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.