Motion2Vector: unsupervised learning in human activity recognition using wrist-sensing data

With the increasing popularity of consumer wearable devices augmented with sensing capabilities (smart bands, smart watches), there is a significant focus on extracting meaningful information about human behaviour through large scale real-world wearable sensor data. The focus of this work is to develop techniques to detect human activities, utilising a large dataset of wearable data where no ground truth has been produced on the actual activities performed. We propose a deep learning variational auto encoder activity recognition model - Motion2Vector. The model is trained using large amounts of unlabelled human activity data to learn a representation of a time period of activity data. The learned activity representations can be mapped into an embedded activity space and grouped with regards to the nature of the activity type. In order to evaluate the proposed model, we have applied our method on public dataset - The Heterogeneity Human Activity Recognition (HHAR) dataset. The results showed that our method can achieve improved result over the HHAR dataset. In addition, we have collected our own lab-based activity dataset. Our experimental results show that our system achieves good accuracy in detecting such activities, and has the potential to provide additional insights in understanding the real-world activity in the situations where there is no ground truth available.

[1]  Ying Wah Teh,et al.  Deep learning algorithms for human activity recognition using mobile and wearable sensor networks: State of the art and research challenges , 2018, Expert Syst. Appl..

[2]  Wolfram Burgard,et al.  Accurate human motion capture in large areas by combining IMU- and laser-based people tracking , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Paul Lukowicz,et al.  Recognizing and Discovering Human Actions from On-Body Sensor Data , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Franco Cicirelli,et al.  On the Design of Smart Homes: A Framework for Activity Recognition in Home Environment , 2016, Journal of Medical Systems.

[5]  Nirmalya Roy,et al.  DeActive , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[6]  Mikkel Baun Kjærgaard,et al.  Smart Devices are Different: Assessing and MitigatingMobile Sensing Heterogeneities for Activity Recognition , 2015, SenSys.

[7]  Douglas Eck,et al.  A Neural Representation of Sketch Drawings , 2017, ICLR.

[8]  Maria E. Niessen,et al.  Monitoring Activities of Daily Living in Smart Homes: Understanding human behavior , 2016, IEEE Signal Processing Magazine.

[9]  Shuangquan Wang,et al.  Human activity recognition with user-free accelerometers in the sensor networks , 2005, 2005 International Conference on Neural Networks and Brain.

[10]  Changseok Bae,et al.  Unsupervised learning for human activity recognition using smartphone sensors , 2014, Expert Syst. Appl..

[11]  Martial Hebert,et al.  Temporal segmentation and activity classification from first-person sensing , 2009, 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Sethuraman Panchanathan,et al.  Analysis of low resolution accelerometer data for continuous human activity recognition , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Bo Yu,et al.  Convolutional Neural Networks for human activity recognition using mobile sensors , 2014, 6th International Conference on Mobile Computing, Applications and Services.

[14]  Marcus Edel,et al.  Binarized-BLSTM-RNN based Human Activity Recognition , 2016, 2016 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[15]  Donghai Guan,et al.  Activity Recognition Based on Semi-supervised Learning , 2007, 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications (RTCSA 2007).

[16]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[17]  Bruce H. Dobkin,et al.  A Rehabilitation-Internet-of-Things in the Home to Augment Motor Skills and Exercise Training , 2017, Neurorehabilitation and neural repair.

[18]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.