Deep Learning Model for Human Activity Recognition and Prediction in Smart Homes

To solve the limitation problem of traditional human activity recognition (HAR) tasks which use features extracted manually and some shallow machine learning models, a novel multi-task layer neural network (LSTM) model is proposed based on the ability of deep neural network to automatically extract features in a smart home, combined with the recent successful recurrent neural network and convolution neural network. Prediction techniques based on LSTM neural networks in smart home environments have been used to predicting the next activity as well as on the task of predicting the timestamp of the next event as well. The performance of the model is evaluated on the real dataset. Experimental results show that the LSTM neural networks outperform the other approaches for the prediction of the direct next event, meanwhile, the application of multi-task learning by jointly predicting the next activity and the timestamp of the next event outperforms separate LSTM models for both tasks separately.

[1]  Qing Ye,et al.  Human Behavior Recognition Based On CNN , 2017 .

[2]  Lin Zhang,et al.  Poster Abstract: Analysis and Evaluation of Driving Behavior Recognition Based on a 3-axis Accelerometer Using a Random Forest Approach , 2017, 2017 16th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[3]  Marlon Dumas,et al.  Predictive Business Process Monitoring with LSTM Neural Networks , 2016, CAiSE.

[4]  Bala Srinivasan,et al.  Adaptive mobile activity recognition system with evolving data streams , 2015, Neurocomputing.

[5]  Yue Chen,et al.  一种基于特征增强和决策融合的人体行为识别方法 (Method of Human Activity Recognition Based on Feature Enhancement and Decision Fusion) , 2016, 计算机科学.

[6]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Zhang Dongcheng,et al.  Recognizing construction worker activities based on accelerometers , 2017 .

[9]  Luo Jia Research of Wearable Abnormal Behavior Detection System for Elderly Based on Cloud Computing , 2015 .

[10]  Sung-Bae Cho,et al.  Human activity recognition with smartphone sensors using deep learning neural networks , 2016, Expert Syst. Appl..

[11]  LiFeng,et al.  Human Motion Recognition Based on Triaxial Accelerometer , 2016 .

[12]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[13]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[14]  M Schmid,et al.  An adaptive Kalman-based Bayes estimation technique to classify locomotor activities in young and elderly adults through accelerometers. , 2010, Medical engineering & physics.

[15]  Yeng Chai Soh,et al.  Robust Human Activity Recognition Using Smartphone Sensors via CT-PCA and Online SVM , 2017, IEEE Transactions on Industrial Informatics.