Activity inference engine for real-time cognitive assistance in smart environments

Recent research in ambient intelligence allows wireless sensor networks to perceive environmental states and their changes in smart environments. An intelligent living environment could not only provide better interactions with its ambiance, inside electrical devices and everyday objects, but also offer smart services, even smart assistance to disabled or elderly people when necessary. This paper proposes a new inference engine based on the formal concept analysis to achieve activity prediction and recognition, even abnormal behavioral pattern detection for ambient-assisted living. According to occupants’ historical data, we explore useful frequent patterns to guide future prediction, recognition and detection tasks. Like the way of human reasoning, the engine could incrementally infer the most probable activity according to successive observations. Furthermore, we propose a hierarchical clustering approach to merge activities according to their semantic similarities. As an optimized knowledge discovery approach in hierarchical ambient intelligence environments, it could optimize the prediction accuracies at the earliest stages when only a few observations are available.

[1]  Diane J. Cook,et al.  CRAFFT: an activity prediction model based on Bayesian networks , 2015, J. Ambient Intell. Humaniz. Comput..

[2]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[3]  Diane J. Cook,et al.  Data-Driven Activity Prediction: Algorithms, Evaluation Methodology, and Applications , 2015, KDD.

[4]  Francesco Orciuoli,et al.  Unfolding social content evolution along time and semantics , 2017, Future Gener. Comput. Syst..

[5]  Marimuthu Palaniswami,et al.  Internet of Things (IoT): A vision, architectural elements, and future directions , 2012, Future Gener. Comput. Syst..

[6]  ISTVAN JONYER,et al.  Graph-Based Hierarchical Conceptual Clustering , 2000, Int. J. Artif. Intell. Tools.

[7]  Been-Chian Chien,et al.  Activity Recognition Using Discriminant Sequence Patterns in Smart Environments , 2014, PAKDD Workshops.

[8]  Abdenour Bouzouane,et al.  Method of Recognition and Assistance Combining Passive RFID and Electrical Load Analysis That Handles Cognitive Errors , 2015, Int. J. Distributed Sens. Networks.

[9]  Anna Formica,et al.  Ontology-based concept similarity in Formal Concept Analysis , 2006, Inf. Sci..

[10]  Michael S. Ryoo,et al.  Human activity prediction: Early recognition of ongoing activities from streaming videos , 2011, 2011 International Conference on Computer Vision.

[11]  Andreas Nürnberger,et al.  Adaptive Multimedia Retrieval: Retrieval, User, and Semantics , 2008 .

[12]  C. Fabrigoule,et al.  Disability and cognitive impairment in the elderly. , 1997, Disability and rehabilitation.

[13]  Vincenzo Loia,et al.  Formal and relational concept analysis for fuzzy-based automatic semantic annotation , 2013, Applied Intelligence.

[14]  Juan Carlos Augusto,et al.  Ambient Intelligence—the Next Step for Artificial Intelligence , 2008, IEEE Intelligent Systems.

[15]  Charu C. Aggarwal,et al.  Feature Selection for Classification: A Review , 2014, Data Classification: Algorithms and Applications.

[16]  Bruno Bouchard,et al.  Cognitive Errors Detection: Mining Behavioral Data Stream of People with Cognitive Impairment , 2016, PETRA.

[17]  Fariba Sadri,et al.  Ambient intelligence: A survey , 2011, CSUR.

[18]  Jonas Poelmans,et al.  Formal concept analysis in knowledge processing: A survey on applications , 2013, Expert Syst. Appl..

[19]  Janet L. Kolodner,et al.  An introduction to case-based reasoning , 1992, Artificial Intelligence Review.

[20]  Abdenour Bouzouane,et al.  A KEYHOLE PLAN RECOGNITION MODEL FOR ALZHEIMER'S PATIENTS: FIRST RESULTS , 2007, Appl. Artif. Intell..

[21]  Charu C. Aggarwal,et al.  Data Clustering , 2013 .

[22]  J. Broekens,et al.  Assistive social robots in elderly care: a review , 2009 .

[23]  Bruno Bouchard,et al.  Validation of a Smart Stove for Traumatic Brain Injury Patients in a Cooking Task , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[24]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[25]  Simon A. Dobson,et al.  Exploring semantics in activity recognition using context lattices , 2010, J. Ambient Intell. Smart Environ..

[26]  R. Belohlávek Fuzzy Relational Systems: Foundations and Principles , 2002 .

[27]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[28]  Hwee Pink Tan,et al.  Machine Learning in Wireless Sensor Networks: Algorithms, Strategies, and Applications , 2014, IEEE Communications Surveys & Tutorials.

[29]  Diane J. Cook,et al.  A Data Mining Framework for Activity Recognition in Smart Environments , 2010, 2010 Sixth International Conference on Intelligent Environments.

[30]  Diane J. Cook,et al.  Author's Personal Copy Pervasive and Mobile Computing Ambient Intelligence: Technologies, Applications, and Opportunities , 2022 .

[31]  Subhas Mukhopadhyay,et al.  Forecasting the behavior of an elderly using wireless sensors data in a smart home , 2013, Eng. Appl. Artif. Intell..

[32]  Gian Luca Foresti,et al.  Ambient Intelligence: A New Multidisciplinary Paradigm , 2005 .

[33]  Stephen S. Yau,et al.  Hierarchical situation modeling and reasoning for pervasive computing , 2006, The Fourth IEEE Workshop on Software Technologies for Future Embedded and Ubiquitous Systems, and the Second International Workshop on Collaborative Computing, Integration, and Assurance (SEUS-WCCIA'06).

[34]  Ray Bareiss,et al.  Concept Learning and Heuristic Classification in WeakTtheory Domains , 1990, Artif. Intell..

[35]  Athanasios V. Vasilakos,et al.  A Survey on Ambient Intelligence in Healthcare , 2013, Proceedings of the IEEE.

[36]  Vincenzo Loia,et al.  Hierarchical web resources retrieval by exploiting Fuzzy Formal Concept Analysis , 2012, Inf. Process. Manag..

[37]  Vincenzo Loia,et al.  Hybrid methodologies to foster ontology-based knowledge management platform , 2013, 2013 IEEE Symposium on Intelligent Agents (IA).

[38]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[39]  Ray Bareiss,et al.  Exemplar-Based Knowledge Acquisition: A Unified Approach to Concept Representation, Classification, and Learning , 1990 .

[40]  Jian Pei,et al.  A brief survey on sequence classification , 2010, SKDD.

[41]  Mimmo Parente,et al.  Time Aware Knowledge Extraction for microblog summarization on Twitter , 2015, Inf. Fusion.

[42]  Diane J. Cook,et al.  Human Activity Recognition and Pattern Discovery , 2010, IEEE Pervasive Computing.

[43]  Anand Rajaraman,et al.  Mining of Massive Datasets , 2011 .

[44]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[45]  Abdenour Bouzouane,et al.  A Possibilistic Approach for Activity Recognition in Smart Homes for Cognitive Assistance to Alzheimer’s Patients , 2011 .

[46]  Diane J. Cook,et al.  How smart are our environments? An updated look at the state of the art , 2007, Pervasive Mob. Comput..

[47]  Diane J. Cook,et al.  Using Bayesian Networks for Daily Activity Prediction , 2013, AAAI Workshop: Plan, Activity, and Intent Recognition.

[48]  Liyanage C. De Silva,et al.  State of the art of smart homes , 2012, Eng. Appl. Artif. Intell..

[49]  Bruno Bouchard,et al.  Towards User Activity Recognition Through Energy Usage Analysis And Complex Event Processing , 2016, PETRA.

[50]  Gwenn Englebienne,et al.  Hierarchical Activity Recognition Using Automatically Clustered Actions , 2011, AmI.

[51]  Bernhard Ganter,et al.  Formal Concept Analysis: Mathematical Foundations , 1998 .

[52]  Abdenour Bouzouane,et al.  Nonintrusive system for assistance and guidance in smart homes based on electrical devices identification , 2015, Expert Syst. Appl..

[53]  Abdenour Bouzouane,et al.  Real-Time Activity Prediction and Recognition in Smart Homes by Formal Concept Analysis , 2016, 2016 12th International Conference on Intelligent Environments (IE).

[54]  Jesse Hoey,et al.  Sensor-Based Activity Recognition , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).