Modeling long-term human activeness using recurrent neural networks for biometric data

BackgroundWith the invention of fitness trackers, it has been possible to continuously monitor a user’s biometric data such as heart rates, number of footsteps taken, and amount of calories burned. This paper names the time series of these three types of biometric data, the user’s “activeness”, and investigates the feasibility in modeling and predicting the long-term activeness of the user.MethodsThe dataset used in this study consisted of several months of biometric time-series data gathered by seven users independently. Four recurrent neural network (RNN) architectures–as well as a deep neural network and a simple regression model–were proposed to investigate the performance on predicting the activeness of the user under various length-related hyper-parameter settings. In addition, the learned model was tested to predict the time period when the user’s activeness falls below a certain threshold.ResultsA preliminary experimental result shows that each type of activeness data exhibited a short-term autocorrelation; and among the three types of data, the consumed calories and the number of footsteps were positively correlated, while the heart rate data showed almost no correlation with neither of them. It is probably due to this characteristic of the dataset that although the RNN models produced the best results on modeling the user’s activeness, the difference was marginal; and other baseline models, especially the linear regression model, performed quite admirably as well. Further experimental results show that it is feasible to predict a user’s future activeness with precision, for example, a trained RNN model could predict–with the precision of 84%–when the user would be less active within the next hour given the latest 15 min of his activeness data.ConclusionsThis paper defines and investigates the notion of a user’s “activeness”, and shows that forecasting the long-term activeness of the user is indeed possible. Such information can be utilized by a health-related application to proactively recommend suitable events or services to the user.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Elif Derya Übeyli.  Combining recurrent neural networks with eigenvector methods for classification of ECG beats , 2009, Digit. Signal Process..

[3]  Björn W. Schuller,et al.  Real-life voice activity detection with LSTM Recurrent Neural Networks and an application to Hollywood movies , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Antonio Messineo,et al.  Using Recurrent Artificial Neural Networks to Forecast Household Electricity Consumption , 2012 .

[6]  Prasant Mohapatra,et al.  Energy expenditure estimation with smartphone body sensors , 2013 .

[7]  Rosaria Silipo,et al.  Artificial neural networks for automatic ECG analysis , 1998, IEEE Trans. Signal Process..

[8]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[9]  Kenyon Findley,et al.  Perceived Effectiveness of Fitness Trackers Among Adults , 2015 .

[10]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[11]  Lukás Burget,et al.  Extensions of recurrent neural network language model , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  Gord Miller,et al.  Critical synthesis of wellness literature , 2010 .

[13]  T. Noakes,et al.  Prediction of energy expenditure from heart rate monitoring during submaximal exercise , 2005, Journal of sports sciences.

[14]  Hitoshi Iba,et al.  Reconstruction of Gene Regulatory Networks from Gene Expression Data Using Decoupled Recurrent Neural Network Model , 2013 .

[15]  Guang-Zhong Yang,et al.  Predicting Free-Living Energy Expenditure Using a Miniaturized Ear-Worn Sensor: An Evaluation Against Doubly Labeled Water , 2014, IEEE Transactions on Biomedical Engineering.

[16]  Charles Elkan,et al.  Learning to Diagnose with LSTM Recurrent Neural Networks , 2015, ICLR.

[17]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[18]  Peter C Austin,et al.  Using methods from the data-mining and machine-learning literature for disease classification and prediction: a case study examining classification of heart failure subtypes. , 2013, Journal of clinical epidemiology.

[19]  Toshio Tsuji,et al.  Evaluation of heart rate variability by using wavelet transform and a recurrent neural network , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  O. I. Shittu,et al.  Estimates of Bull and Bear parameters in Smooth Threshold Parameter Nonlinear Market model: A Comparative study between Nigerian and Foreign Stock Markets , 2013 .

[21]  Keiichi Yasumoto,et al.  Estimating heart rate variation during walking with smartphone , 2013, UbiComp.

[22]  Andrey V. Savkin,et al.  Nonlinear Modeling and Control of Human Heart Rate Response During Exercise With Various Work Load Intensities , 2008, IEEE Transactions on Biomedical Engineering.

[23]  Henrik Jacobsson,et al.  Rule Extraction from Recurrent Neural Networks: ATaxonomy and Review , 2005, Neural Computation.

[24]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[25]  Yi Zheng,et al.  Time Series Classification Using Multi-Channels Deep Convolutional Neural Networks , 2014, WAIM.