A Scalable Hybrid Activity Recognition Approach for Intelligent Environments

Human activity recognition is a key technology for ICT-based (infomation and communication technologies) assistive applications. The most successful activity recognition systems for intelligent environments in terms of performance rely on supervised learning techniques. However, those techniques demand large labelled data sets for specific sensor deployments and monitored person. Such requirements make supervised learning techniques not to scale well to real world deployments, where different sensor infrastructures may be used to monitor different users. In this paper, we present a novel activity recognition system, based on a combination of unsupervised learning techniques and knowledge-based activity models. First, we use a domain-specific data mining algorithm previously developed by Cook et al. to extract the most frequent action sequences executed by a person. Second, we insert knowledge-based activity models in a novel matching algorithm with the aim of inferring what activities are being performed in a given action sequence. The approach results on a scalable activity recognition system, which has been tested on three real data sets. The obtained performance is comparable to supervised learning techniques.

[1]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[2]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[3]  Oliver Brdiczka,et al.  Learning Situation Models in a Smart Home , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[4]  Diane J. Cook,et al.  Discovering frequent user--environment interactions in intelligent environments , 2011, Personal and Ubiquitous Computing.

[5]  Eric Horvitz,et al.  Layered representations for learning and inferring office activity from multiple sensory channels , 2004, Comput. Vis. Image Underst..

[6]  Diane J. Cook,et al.  COM: A method for mining and monitoring human activity patterns in home-based health monitoring systems , 2013, ACM Trans. Intell. Syst. Technol..

[7]  Jian Lu,et al.  An unsupervised approach to activity recognition and segmentation based on object-use fingerprints , 2010, Data Knowl. Eng..

[8]  Donald E. Brown,et al.  Health-status monitoring through analysis of behavioral patterns , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  Aitor Almeida,et al.  Extending knowledge-driven activity models through data-driven learning techniques , 2015, Expert Syst. Appl..

[10]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[11]  Yuxin Peng,et al.  Complex activity recognition using time series pattern dictionary learned from ubiquitous sensors , 2016, Inf. Sci..

[12]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[13]  Tao Gu,et al.  Object relevance weight pattern mining for activity recognition and segmentation , 2010, Pervasive Mob. Comput..

[14]  Araceli Sanchis,et al.  Online activity recognition using evolving classifiers , 2013, Expert Syst. Appl..

[15]  Diane J. Cook,et al.  Improving home automation by discovering regularly occurring device usage patterns , 2003, Third IEEE International Conference on Data Mining.

[16]  Simon A. Dobson,et al.  USMART , 2014, ACM Trans. Interact. Intell. Syst..

[17]  Diane J. Cook,et al.  Keeping the Resident in the Loop: Adapting the Smart Home to the User , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[19]  Edwin Naroska,et al.  Unsupervised Recognition of ADLs , 2010, SETN.

[20]  Bernt Schiele,et al.  Unsupervised Discovery of Structure in Activity Data Using Multiple Eigenspaces , 2006, LoCA.

[21]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[22]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[23]  L. Ferrucci,et al.  Measures of physical performance and risk for progressive and catastrophic disability: results from the Women's Health and Aging Study. , 2005, The journals of gerontology. Series A, Biological sciences and medical sciences.

[24]  D. A. Gold,et al.  An examination of instrumental activities of daily living assessment in older adults and mild cognitive impairment , 2012, Journal of clinical and experimental neuropsychology.

[25]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[26]  Aphrodite Galata,et al.  Learning structured behaviour models using variable length Markov models , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[27]  Oliver Brdiczka,et al.  Detecting Individual Activities from Video in a Smart Home , 2007, KES.

[28]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[29]  Rémi Ronfard,et al.  A survey of vision-based methods for action representation, segmentation and recognition , 2011, Comput. Vis. Image Underst..

[30]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[31]  Changseok Bae,et al.  Unsupervised learning for human activity recognition using smartphone sensors , 2014, Expert Syst. Appl..

[32]  Zoran A. Salcic,et al.  Enhancing ontological reasoning with uncertainty handling for activity recognition , 2016, Knowl. Based Syst..

[33]  Gwenn Englebienne,et al.  Human activity recognition from wireless sensor network data: benchmark and software , 2011 .

[34]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[35]  Jian Pei,et al.  Constraint-based sequential pattern mining: the pattern-growth methods , 2007, Journal of Intelligent Information Systems.

[36]  Chris D. Nugent,et al.  A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home , 2008 .

[37]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[38]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[39]  Timo Sztyler,et al.  Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning , 2016, UbiComp.

[40]  Diane J. Cook,et al.  Activity Discovery and Activity Recognition: A New Partnership , 2013, IEEE Transactions on Cybernetics.