Using change point detection to automate daily activity segmentation

Real time detection of transitions between activities based on sensor data is a valuable but somewhat untapped challenge. Detecting these transitions is useful for activity segmentation, for timing notifications or interventions, and for analyzing human behavior. In this work, we design and evaluate real time machine learning-based methods for automatic segmentation and recognition of continuous human daily activity. We detect activity transitions and integrate the change point detection algorithm with smart home activity recognition to segment human daily activities into separate actions and correctly identify each action. Experiments with on real-world smart home datasets suggest that using transition aware activity recognition algorithms lead to best performance for detecting activity boundaries and streaming activity segmentation.

[1]  Tadashi Okoshi,et al.  Attelia: Reducing user's cognitive load due to interruptive notifications on smart phones , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  Nirmalya Roy,et al.  A smart segmentation technique towards improved infrequent non-speech gestural activity recognition model , 2017, Pervasive Mob. Comput..

[3]  Diane J. Cook,et al.  A survey of methods for time series change point detection , 2017, Knowledge and Information Systems.

[4]  Guang-Zhong Yang,et al.  Semi-supervised segmentation for activity recognition with Multiple Eigenspaces , 2008, 2008 5th International Summer School and Symposium on Medical Devices and Biosensors.

[5]  Diane J. Cook,et al.  Activity Learning: Discovering, Recognizing, and Predicting Human Behavior from Sensor Data , 2015 .

[6]  Diane J. Cook,et al.  Toward personalized and context-aware prompting for smartphone-based intervention , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Masashi Sugiyama,et al.  Change-point detection in time-series data by relative density-ratio estimation , 2012 .

[8]  Brian P. Bailey,et al.  On the need for attention-aware systems: Measuring effects of interruption on task performance, error rate, and affective state , 2006, Comput. Hum. Behav..

[9]  Masashi Sugiyama,et al.  Sequential change‐point detection based on direct density‐ratio estimation , 2012, Stat. Anal. Data Min..

[10]  Davide Anguita,et al.  Transition-Aware Human Activity Recognition Using Smartphones , 2016, Neurocomputing.

[11]  Diane J. Cook,et al.  Automated Detection of Activity Transitions for Prompting , 2015, IEEE Transactions on Human-Machine Systems.

[12]  Ryan P. Adams,et al.  Bayesian Online Changepoint Detection , 2007, 0710.3742.

[13]  Heng Wang,et al.  Unsupervised Human Activity Segmentation Applying Smartphone Sensor for Healthcare , 2015, 2015 IEEE 12th Intl Conf on Ubiquitous Intelligence and Computing and 2015 IEEE 12th Intl Conf on Autonomic and Trusted Computing and 2015 IEEE 15th Intl Conf on Scalable Computing and Communications and Its Associated Workshops (UIC-ATC-ScalCom).

[14]  Hassan Ghasemzadeh,et al.  Autonomous sensor-context learning in dynamic human-centered Internet-of-Things environments , 2016, 2016 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[15]  Brian P. Bailey,et al.  A framework for specifying and monitoring user tasks , 2006, Comput. Hum. Behav..

[16]  Jake K. Aggarwal,et al.  Segmentation and recognition of continuous human activity , 2001, Proceedings IEEE Workshop on Detection and Recognition of Events in Video.