Learning ADL Daily Routines with Spatiotemporal Neural Networks

Activities of daily living (ADLs) refer to the activities performed by individuals on a daily basis and are the indicators of a person's habits, lifestyle, and wellbeing. Consequently, learning an individual's ADL daily routines has significant value in the healthcare domain. Specifically, ADL recognition and inter-ADL pattern learning problems have been studied extensively in the past couple of decades. However, discovering the patterns of ADLs performed in a day and clustering them into ADL daily routines has been a relatively unexplored research area. In this paper, a self-organizing neural network model, called the Spatiotemporal ADL Adaptive Resonance Theory (STADLART), is proposed for learning ADL daily routines. STADLART integrates multimodal contextual information that involves the time and space wherein the ADLs are performed. By encoding spatiotemporal information explicitly as input features, STADLART enables the learning of time-sensitive knowledge. Moreover, a STADLART variation named STADLART-NC is proposed to normalize and customize ADL weighting for daily routine learning. A weighting assignment scheme is presented that facilitates the assignment of weighting according to ADL importance in specific domains. Empirical experiments using both synthetic and real-world public data sets validate the performance of STADLART and STADLART-NC when compared with alternative pattern discovery methods. The results show that STADLART could cluster ADL routines with better performance than baseline algorithms.

[1]  Olivier Buffet,et al.  Simulation-based behavior tracking of pedestrians in partially observed indoor environments , 2014, AAMAS.

[2]  Haizhou Li,et al.  How the Brain Formulates Memory: A Spatio-Temporal Model Research Frontier , 2016, IEEE Computational Intelligence Magazine.

[3]  Ah-Hwee Tan,et al.  Concept Hierarchy Memory Model: a Neural Architecture for Conceptual Knowledge Representation, Learning, and Commonsense Reasoning , 1996, Int. J. Neural Syst..

[4]  Janet V. DeLany,et al.  Occupational therapy practice framework: domain & practice, 2nd edition. , 2008, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[5]  Peter J. Rousseeuw,et al.  Finding Groups in Data: An Introduction to Cluster Analysis , 1990 .

[6]  Diane J. Cook,et al.  Learning Setting-Generalized Activity Models for Smart Spaces , 2012, IEEE Intelligent Systems.

[7]  Bor-Chen Kuo,et al.  A New Weighted Fuzzy C-Means Clustering Algorithm for Remotely Sensed Image Classification , 2011, IEEE Journal of Selected Topics in Signal Processing.

[8]  Michael K. Ng,et al.  Automated variable weighting in k-means type clustering , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  W. Scott Spangler,et al.  Feature Weighting in k-Means Clustering , 2003, Machine Learning.

[10]  Stephen Grossberg,et al.  Intelligence Through Interaction: Towards a Unified Theory for Learning , 2007, ISNN.

[11]  Xinbo Gao,et al.  A New Feature Weighted Fuzzy Clustering Algorithm , 2005, RSFDGrC.

[12]  Shan Gao,et al.  User daily activity pattern learning: A multi-memory modeling approach , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[13]  Diane J. Cook,et al.  MINING TEMPORAL SEQUENCES TO DISCOVER INTERESTING PATTERNS , 2004 .

[14]  Georgios C. Anagnostopoulos,et al.  Fuzzy ART and Fuzzy ARTMAP with adaptively weighted distances , 2002, SPIE Defense + Commercial Sensing.

[15]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[16]  Philippe Lenca,et al.  Monitoring the Habits of Elderly People through Data Mining from Home Automation Devices Data , 2013, EPIA.

[17]  R. Bucks,et al.  Assessment of activities of daily living in dementia: development of the Bristol Activities of Daily Living Scale. , 1996, Age and ageing.

[18]  Michael Karg,et al.  Low cost activity recognition using depth cameras and context dependent spatial regions , 2014, AAMAS.

[19]  Lucian Sasu,et al.  A Novel Fuzzy ARTMAP Architecture with Adaptive FeatureWeights based on Onicescu's Informational Energy , 2009, Int. J. Comput. Commun. Control.

[20]  Philippe Lenca,et al.  Periodic Episode Discovery Over Event Streams , 2015, EPIA.

[21]  S. Grossberg,et al.  Fuzzy ART: an adaptive resonance algorithm for rapid, stable classification of analog patterns , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[22]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[23]  M. Lawton,et al.  Assessment of older people: self-maintaining and instrumental activities of daily living. , 1969, The Gerontologist.

[24]  Andreas Savvides,et al.  Extracting spatiotemporal human activity patterns in assisted living using a home sensor network , 2008, PETRA.

[25]  Wenwen Wang,et al.  Neural Modeling of Episodic Memory: Encoding, Retrieval, and Forgetting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Alexandros André Chaaraoui,et al.  A review on vision techniques applied to Human Behaviour Analysis for Ambient-Assisted Living , 2012, Expert Syst. Appl..