Activity2Vec: Learning ADL Embeddings from Sensor Data with a Sequence-to-Sequence Model

Recognizing activities of daily living (ADLs) plays an essential role in analyzing human health and behavior. The widespread availability of sensors implanted in homes, smartphones, and smart watches have engendered collection of big datasets that reflect human behavior. To obtain a machine learning model based on these data,researchers have developed multiple feature extraction methods. In this study, we investigate a method for automatically extracting universal and meaningful features that are applicable across similar time series-based learning tasks such as activity recognition and fall detection. We propose creating a sequence-to-sequence (seq2seq) model to perform this feature learning. Beside avoiding feature engineering, the meaningful features learned by the seq2seq model can also be utilized for semi-supervised learning. We evaluate both of these benefits on datasets collected from wearable and ambient sensors.

[1]  Trevor Darrell,et al.  Sequence to Sequence -- Video to Text , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Lior Rokach,et al.  Towards latent context-aware recommendation systems , 2016, Knowl. Based Syst..

[3]  Diane J. Cook,et al.  Enhancing activity recognition using CPD-based activity segmentation , 2019, Pervasive Mob. Comput..

[4]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[5]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[6]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[7]  Cain C T Clark,et al.  A Review of Emerging Analytical Techniques for Objective Physical Activity Measurement in Humans , 2016, Sports Medicine.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Mario Muñoz Organero,et al.  Time-Elastic Generative Model for Acceleration Time Series in Human Activity Recognition , 2017, Sensors.

[10]  A. Azzouz 2011 , 2020, City.

[11]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[12]  Guilin Chen,et al.  Human Activity Recognition in a Smart Home Environment with Stacked Denoising Autoencoders , 2016, WAIM Workshops.

[13]  Shehroz S. Khan,et al.  Detecting unseen falls from wearable devices using channel-wise ensemble of autoencoders , 2016, Expert Syst. Appl..

[14]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[15]  Tara N. Sainath,et al.  A Comparison of Sequence-to-Sequence Models for Speech Recognition , 2017, INTERSPEECH.

[16]  Davide Anguita,et al.  A Public Domain Dataset for Human Activity Recognition using Smartphones , 2013, ESANN.