An Ontology-Based Hybrid Approach to Activity Modeling for Smart Homes

Activity models play a critical role for activity recognition and assistance in ambient assisted living. Existing approaches to activity modeling suffer from a number of problems, e.g., cold-start, model reusability, and incompleteness. In an effort to address these problems, we introduce an ontology-based hybrid approach to activity modeling that combines domain knowledge based model specification and data-driven model learning. Central to the approach is an iterative process that begins with “seed” activity models created by ontological engineering. The “seed” models are deployed, and subsequently evolved through incremental activity discovery and model update. While our previous work has detailed ontological activity modeling and activity recognition, this paper focuses on the systematic hybrid approach and associated methods and inference rules for learning new activities and user activity profiles. The approach has been implemented in a feature-rich assistive living system. Analysis of the experiments conducted has been undertaken in an effort to test and evaluate the activity learning algorithms and associated mechanisms.

[1]  Matthai Philipose,et al.  Building Reliable Activity Models Using Hierarchical Shrinkage and Mined Ontology , 2006, Pervasive.

[2]  D. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Activity Knowledge Transfer in Smart Environments , 2022 .

[3]  Qiang Yang,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Transfer Learning for Activity Recognition via Sensor Mapping , 2022 .

[4]  Chris D. Nugent,et al.  A Logical Framework for Behaviour Reasoning and Assistance in a Smart Home , 2008 .

[5]  John A. Quinn,et al.  Factorial Switching Linear Dynamical Systems Applied to Physiological Condition Monitoring , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[7]  Chris D. Nugent,et al.  Segmenting sensor data for activity monitoring in smart environments , 2012, Personal and Ubiquitous Computing.

[8]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[9]  Eric Campo,et al.  A review of smart homes - Present state and future challenges , 2008, Comput. Methods Programs Biomed..

[10]  Context-Aware Computing,et al.  Inferring Activities from Interactions with Objects , 2004 .

[11]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[12]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Henry A. Kautz A formal theory of plan recognition , 1987 .

[14]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[15]  Andrew McCallum,et al.  Dynamic conditional random fields: factorized probabilistic models for labeling and segmenting sequence data , 2004, J. Mach. Learn. Res..

[16]  Simon A. Dobson,et al.  A top-level ontology for smart environments , 2011, Pervasive Mob. Comput..

[17]  Gwenn Englebienne,et al.  Hierarchical Activity Recognition Using Automatically Clustered Actions , 2011, AmI.

[18]  G. Englebienne,et al.  Transferring Knowledge of Activity Recognition across Sensor Networks , 2010, Pervasive.

[19]  Ian Witten,et al.  Data Mining , 2000 .

[20]  Blake Hannaford,et al.  A Hybrid Discriminative/Generative Approach for Modeling Human Activities , 2005, IJCAI.

[21]  Tao Gu,et al.  Object relevance weight pattern mining for activity recognition and segmentation , 2010, Pervasive Mob. Comput..

[22]  Roy Sterritt,et al.  Dynamic Sensor Data Segmentation for Real- time Activity Recognition , 2011 .

[23]  Diego Calvanese,et al.  The description logic handbook: theory , 2003 .

[24]  M. Lawton,et al.  Assessment of older people: self-maintaining and instrumental activities of daily living. , 1969, The Gerontologist.

[25]  Jesús Favela,et al.  Activity Recognition for the Smart Hospital , 2008, IEEE Intelligent Systems.

[26]  Abdenour Bouzouane,et al.  A Smart Home Agent for Plan Recognition of Cognitively-impaired Patients , 2006, J. Comput..

[27]  Andrew McCallum,et al.  Dynamic Conditional Random Fields for Jointly Labeling Multiple Sequences , 2003 .

[28]  C. Nugent,et al.  Experiences in the development of a Smart Lab , 2009 .

[29]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[30]  Wayne Wobcke,et al.  Two Logical Theories of Plan Recognition , 2002, J. Log. Comput..

[31]  David Taniar,et al.  Information integration and web-based applications and services , 2010 .

[32]  Stuart J. Russell,et al.  Dynamic bayesian networks: representation, inference and learning , 2002 .

[33]  Matthai Philipose,et al.  Mining models of human activities from the web , 2004, WWW '04.

[34]  Diane J. Cook,et al.  Transfer learning for activity recognition: a survey , 2013, Knowledge and Information Systems.

[35]  Daniel Jackson,et al.  Rapid specification and automated generation of prompting systems to assist people with dementia , 2011, Pervasive Mob. Comput..

[36]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[37]  紀彣宙,et al.  國際身心障礙功能與健康分類(International Classification of Functioning, Disability and Health, ICF)簡介 , 2014 .

[38]  Claudio Bettini,et al.  OWL 2 modeling and reasoning with complex human activities , 2011, Pervasive Mob. Comput..

[39]  Liming Chen,et al.  Dynamic sensor data segmentation for real-time knowledge-driven activity recognition , 2014, Pervasive Mob. Comput..

[40]  Oliver Brdiczka,et al.  Learning Situation Models in a Smart Home , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[41]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[42]  Henry A. Kautz,et al.  Hierarchical Conditional Random Fields for GPS-Based Activity Recognition , 2005, ISRR.

[43]  Chris D. Nugent,et al.  Semantic data management for situation-aware assistance in ambient assisted living , 2009, iiWAS.

[44]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[45]  Anthony Rowe,et al.  Location and Activity Recognition Using eWatch: A Wearable Sensor Platform , 2006, Ambient Intelligence in Everyday.

[46]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .