Adaptive activity learning with dynamically available context

Numerous methods have been proposed to address different aspects of human activity recognition. However, most of the previous approaches are static in terms of the data sources used for the recognition task. As sensors can be added or can fail and be replaced by different types of sensors, creating an activity recognition model that is able to leverage dynamically available sensors becomes important. In this paper, we propose methods for activity learning and activity recognition adaptation in environments with dynamic sensor deployments. Specifically, we propose sensor and activity context models to address the problem of sensor heterogeneity, so that sensor readings can be pre-processed and populated into the recognition system properly. Based on those context models, we propose the learning-to-rank method for activity learning and its adaptation. To model the temporal characteristics of the human behaviours, we add temporal regularization into the learning and prediction phases. We use comprehensive datasets to demonstrate effectiveness of the proposed method, and show its advantage over the conventional machine learning algorithms in terms of recognition accuracy. Our method outperforms hybrid models that combine typical machine learning methods with graphical models (i.e. HMM, CRF) for temporal smoothing.

[1]  Jadwiga Indulska,et al.  Sensor-Based Activity Recognition with Dynamically Added Context , 2015, EAI Endorsed Trans. Energy Web.

[2]  Fabio Tozeto Ramos,et al.  Multi-scale Conditional Random Fields for first-person activity recognition , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[3]  Matthai Philipose,et al.  Mining models of human activities from the web , 2004, WWW '04.

[4]  Matthai Philipose,et al.  Building Reliable Activity Models Using Hierarchical Shrinkage and Mined Ontology , 2006, Pervasive.

[5]  Bernt Schiele,et al.  Multi-graph Based Semi-supervised Learning for Activity Recognition , 2009, 2009 International Symposium on Wearable Computers.

[6]  Claudio Bettini,et al.  Fine-grained recognition of abnormal behaviors for early detection of mild cognitive impairment , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[7]  Jian Lu,et al.  An unsupervised approach to activity recognition and segmentation based on object-use fingerprints , 2010, Data Knowl. Eng..

[8]  Matthai Philipose,et al.  Common Sense Based Joint Training of Human Activity Recognizers , 2007, IJCAI.

[9]  Thomas Plötz,et al.  Let's (not) stick together: pairwise similarity biases cross-validation in activity recognition , 2015, UbiComp.

[10]  Tie-Yan Liu,et al.  Learning to rank: from pairwise approach to listwise approach , 2007, ICML '07.

[11]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[12]  Martin L. Griss,et al.  Nonparametric discovery of human routines from sensor data , 2014, 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[13]  Yong Yu,et al.  Collaborative personalized tweet recommendation , 2012, SIGIR '12.

[14]  Jadwiga Indulska,et al.  Creating general model for activity recognition with minimum labelled data , 2015, SEMWEB.

[15]  Matthai Philipose,et al.  Unsupervised Activity Recognition Using Automatically Mined Common Sense , 2005, AAAI.

[16]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[17]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[18]  Nirmalya Roy,et al.  Mobeacon: An iBeacon-Assisted Smartphone-Based Real Time Activity Recognition Framework , 2015, EAI Endorsed Trans. Ubiquitous Environ..

[19]  Paul Lukowicz,et al.  Glass-physics: using google glass to support high school physics experiments , 2015, SEMWEB.

[20]  Paul Lukowicz,et al.  Smart table surface: A novel approach to pervasive dining monitoring , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[21]  Xiaoli Li,et al.  An integrated framework for human activity classification , 2012, UbiComp.

[22]  Martin L. Griss,et al.  Towards zero-shot learning for human activity recognition using semantic attribute sequence model , 2013, UbiComp.

[23]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[24]  Didier Stricker,et al.  Personalized mobile physical activity recognition , 2013, ISWC '13.

[25]  Lei Cen,et al.  Personalized Mobile App Recommendation: Reconciling App Functionality and User Privacy Preference , 2015, WSDM.

[26]  Paul Lukowicz,et al.  Collecting complex activity datasets in highly rich networked sensor environments , 2010, 2010 Seventh International Conference on Networked Sensing Systems (INSS).

[27]  Oliver Amft,et al.  Mining relations and physical grouping of building-embedded sensors and actuators , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[28]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[29]  Jadwiga Indulska,et al.  An Autonomic Context Management System for Pervasive Computing , 2008, 2008 Sixth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom).

[30]  Takuya Maekawa,et al.  Object-Based Activity Recognition with Heterogeneous Sensors on Wrist , 2010, Pervasive.

[31]  Jadwiga Indulska,et al.  A software engineering framework for context-aware pervasive computing , 2004, Second IEEE Annual Conference on Pervasive Computing and Communications, 2004. Proceedings of the.