An Autoencoder-based Approach for Recognizing Null Class in Activities of Daily Living In-the-wild via Wearable Motion Sensors

Recognizing activities of daily living (ADL) in-the-wild, while users follow their daily routine, is challenging due to the presence of various activities that do not belong to the set of desired activities in which the system is interested (i.e., NULL class). In this paper, we propose a framework for ADL recognition via wearable motion sensors with the ability to detect NULL class. Existing ADL recognition systems either ignore the NULL class or use some training data to train a model for recognizing it. However, our framework uses only samples of the desired activities in the training phase and learns to detect the NULL samples based on a modified variational autoencoder model that outputs reconstruction probability. Experimental results show that in detecting six ADL with accelerometer data, our system achieves 14% higher F1-score compared to the models that use training samples of NULL activities.

[1]  Didier Stricker,et al.  Towards robust activity recognition for everyday life: Methods and evaluation , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[2]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[3]  Francesco Cricri,et al.  Clustering and Unsupervised Anomaly Detection with l2 Normalized Deep Auto-Encoder Representations , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[4]  Reza Malekian,et al.  Physical Activity Recognition From Smartphone Accelerometer Data for User Context Awareness Sensing , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Ig-Jae Kim,et al.  Mobile health monitoring system based on activity recognition using accelerometer , 2010, Simul. Model. Pract. Theory.

[6]  Yang Feng,et al.  Unsupervised Anomaly Detection via Variational Auto-Encoder for Seasonal KPIs in Web Applications , 2018, WWW.

[7]  Nicholas D. Lane,et al.  From smart to deep: Robust activity recognition on smartwatches using deep learning , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[8]  Xiaoli Li,et al.  Deep Convolutional Neural Networks on Multichannel Time Series for Human Activity Recognition , 2015, IJCAI.

[9]  Daniel Roggen,et al.  Designing and sharing activity recognition systems across platforms , 2011 .

[10]  Roozbeh Jafari,et al.  A Wearable System for Recognizing American Sign Language in Real-Time Using IMU and Surface EMG Sensors , 2016, IEEE Journal of Biomedical and Health Informatics.

[11]  Sungzoon Cho,et al.  Variational Autoencoder based Anomaly Detection using Reconstruction Probability , 2015 .

[12]  Nasser Kehtarnavaz,et al.  Weighted fusion of depth and inertial data to improve view invariance for real-time human action recognition , 2017, Commercial + Scientific Sensing and Imaging.

[13]  Philip S. Yu,et al.  Outlier Detection with Uncertain Data , 2008, SDM.

[14]  Yiming Yang,et al.  A Probabilistic Model for Online Document Clustering with Application to Novelty Detection , 2004, NIPS.

[15]  Gary M. Weiss,et al.  Design considerations for the WISDM smart phone-based sensor mining architecture , 2011, SensorKDD '11.

[16]  Laura Gastaldi,et al.  Human Activity Recognition by Wearable Sensors : Comparison of different classifiers for real-time applications , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[17]  Noboru Harada,et al.  Complementary Set Variational Autoencoder for Supervised Anomaly Detection , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).