Rule-Based Real-Time ADL Recognition in a Smart Home Environment

This paper presents a rule-based approach for both offline and real-time recognition of Activities of Daily Living (ADL), leveraging events produced by a non-intrusive multi-modal sensor infrastructure deployed in a residential environment. Novel aspects of the approach include: the ability to recognise arbitrary scenarios of complex activities using bottom-up multi-level reasoning, starting from sensor events at the lowest level; an effective heuristics-based method for distinguishing between actual and ghost images in video data; and a highly accurate indoor localisation approach that fuses different sources of location information. The proposed approach is implemented as a rule-based system using Jess and is evaluated using data collected in a smart home environment. Experimental results show high levels of accuracy and performance, proving the effectiveness of the approach in real world setups.

[1]  James F. Allen Maintaining knowledge about temporal intervals , 1983, CACM.

[2]  Ian Craddock,et al.  A Human Activity Recognition Framework for Healthcare Applications: Ontology, Labelling Strategies, and Best Practice , 2016, IoTBD.

[3]  Majid Mirmehdi,et al.  A multi-modal sensor infrastructure for healthcare in a residential environment , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[4]  Octavian Fratu,et al.  eWALL: An Intelligent Caring Home Environment Offering Personalized Context-Aware Applications Based on Advanced Sensing , 2015, Wireless Personal Communications.

[5]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[6]  Ye Liu,et al.  An ultra-fast human detection method for color-depth camera , 2015, J. Vis. Commun. Image Represent..

[7]  Liming Chen,et al.  Activity Recognition: Approaches, Practices and Trends , 2011 .

[8]  Alexander Artikis,et al.  A logic programming approach to activity recognition , 2009, EiMM '10.

[9]  Heiner Stuckenschmidt,et al.  A probabilistic ontological framework for the recognition of multilevel human activities , 2013, UbiComp.

[10]  Grigoris Antoniou,et al.  Using Constraint Optimization for Conflict Resolution and Detail Control in Activity Recognition , 2011, AmI.

[11]  Claudio Bettini,et al.  COSAR: hybrid reasoning for context-aware activity recognition , 2011, Personal and Ubiquitous Computing.

[12]  Georgios Meditskos,et al.  MetaQ: A knowledge-driven framework for context-aware activity recognition combining SPARQL and OWL 2 activity patterns , 2016, Pervasive Mob. Comput..

[13]  Ernest Friedman Hill,et al.  Jess in Action: Java Rule-Based Systems , 2003 .

[14]  Mohammad Albaida Object-based Activity Recognition with Heterogeneous Sensors on Wrist , 2018 .

[15]  George A. Vouros,et al.  Probabilistic Event Calculus for Event Recognition , 2012, ACM Trans. Comput. Log..