Discovering Activities to Recognize and Track in a Smart Environment

The machine learning and pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of smart home residents, we need to design technologies that recognize and track activities that people normally perform as part of their daily routines. Although approaches do exist for recognizing activities, the approaches are applied to activities that have been preselected and for which labeled training data are available. In contrast, we introduce an automated approach to activity tracking that identifies frequent activities that naturally occur in an individual's routine. With this capability, we can then track the occurrence of regular activities to monitor functional health and to detect changes in an individual's patterns and lifestyle. In this paper, we describe our activity mining and tracking approach, and validate our algorithms on data collected in physical smart environments.

[1]  J. A. Hartigan,et al.  A k-means clustering algorithm , 1979 .

[2]  Jian Pei,et al.  Constraint-based sequential pattern mining: the pattern-growth methods , 2007, Journal of Intelligent Information Systems.

[3]  atherine,et al.  Finding the number of clusters in a data set : An information theoretic approach C , 2003 .

[4]  Martha E. Pollack,et al.  Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment , 2005, AI Mag..

[5]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[6]  Diane J Cook,et al.  Assessing the Quality of Activities in a Smart Environment , 2009, Methods of Information in Medicine.

[7]  Hani Hagras,et al.  A fuzzy embedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[8]  B. Reisberg,et al.  The Alzheimer's Disease Activities of Daily Living International Scale (ADL-IS) , 2001, International Psychogeriatrics.

[9]  Eamonn J. Keogh,et al.  Clustering of time-series subsequences is meaningless: implications for previous and future research , 2004, Knowledge and Information Systems.

[10]  Henry A. Kautz,et al.  Inferring activities from interactions with objects , 2004, IEEE Pervasive Computing.

[11]  Ramakrishnan Srikant,et al.  Mining sequential patterns , 1995, Proceedings of the Eleventh International Conference on Data Engineering.

[12]  Vincent Rialle,et al.  What Do Family Caregivers of Alzheimer’s Disease Patients Desire in Smart Home Technologies? , 2009, Methods of Information in Medicine.

[13]  Emmanuel Munguia Tapia,et al.  Toward Scalable Activity Recognition for Sensor Networks , 2006, LoCA.

[14]  Henry A. Kautz,et al.  Location-Based Activity Recognition using Relational Markov Networks , 2005, IJCAI.

[15]  Rynson W. H. Lau,et al.  Knowledge and Data Engineering for e-Learning Special Issue of IEEE Transactions on Knowledge and Data Engineering , 2008 .

[16]  Karen L. Courtney,et al.  Brief Review: Defining Obtrusiveness in Home Telehealth Technologies: A Conceptual Framework , 2006, J. Am. Medical Informatics Assoc..

[17]  Jiong Yang,et al.  Towards automatic clustering of protein sequences , 2002, Proceedings. IEEE Computer Society Bioinformatics Conference.

[18]  Jesús Favela,et al.  Activity Recognition for the Smart Hospital , 2008, IEEE Intelligent Systems.

[19]  Catherine A. Sugar,et al.  Finding the Number of Clusters in a Dataset , 2003 .

[20]  Gunnar Rätsch,et al.  An Introduction to Boosting and Leveraging , 2002, Machine Learning Summer School.

[21]  Bill N. Schilit,et al.  Activity Recognition for the Digital Home , 2008, Computer.

[22]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[23]  J. Morley,et al.  Aging in Place , 2020, Manoa.

[24]  James J. Callahan,et al.  Aging in Place , 2019 .

[25]  M. Schmitter-Edgecombe,et al.  Characterizing multiple memory deficits and their relation to everyday functioning in individuals with mild cognitive impairment. , 2009, Neuropsychology.

[26]  J. Rissanen,et al.  Modeling By Shortest Data Description* , 1978, Autom..

[27]  André Hardy,et al.  An examination of procedures for determining the number of clusters in a data set , 1994 .

[28]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[29]  Diane J. Cook,et al.  MavHome: an agent-based smart home , 2003, Proceedings of the First IEEE International Conference on Pervasive Computing and Communications, 2003. (PerCom 2003)..

[30]  Ari Visa,et al.  GAIS: A Method for Detecting Interleaved Sequential Patterns from Imperfect Data , 2007, 2007 IEEE Symposium on Computational Intelligence and Data Mining.

[31]  Sajal K. Das,et al.  Smart Environments: Technology, Protocols and Applications (Wiley Series on Parallel and Distributed Computing) , 2004 .

[32]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[33]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[35]  Henry A. Kautz,et al.  An Overview of the Assisted Cognition Project , 2002 .

[36]  O. Okonkwo,et al.  Mild cognitive impairment and everyday function: evidence of reduced speed in performing instrumental activities of daily living. , 2008, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[37]  Misha Pavel,et al.  Distributed Healthcare: Simultaneous Assessment of Multiple Individuals , 2007, IEEE Pervasive Computing.

[38]  Yongmin Kim,et al.  Network Anomaly Detection Based on Clustering of Sequence Patterns , 2006, ICCSA.

[39]  Donald E. Brown,et al.  Health-status monitoring through analysis of behavioral patterns , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[40]  Diane J. Cook,et al.  Smart environments - technology, protocols and applications , 2004 .

[41]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[42]  Qiang Yang,et al.  Sensor-Based Abnormal Human-Activity Detection , 2008, IEEE Transactions on Knowledge and Data Engineering.

[43]  Mohammed J. Zaki,et al.  PlanMine: Sequence Mining for Plan Failures , 1998, KDD.

[44]  S Szewcyzk,et al.  Annotating smart environment sensor data for activity learning. , 2009, Technology and health care : official journal of the European Society for Engineering and Medicine.

[45]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[46]  Anne Laurent,et al.  S2MP: Similarity Measure for Sequential Patterns , 2008, AusDM.

[47]  Diane J. Cook,et al.  Improving home automation by discovering regularly occurring device usage patterns , 2003, Third IEEE International Conference on Data Mining.

[48]  Gregory D. Abowd,et al.  Designing for the Human Experience in Smart Environments , 2005 .

[49]  Samy Bengio,et al.  Boosting HMMs with an application to speech recognition , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[50]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[51]  Holger Schwenk,et al.  Using boosting to improve a hybrid HMM/neural network speech recognizer , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[52]  Diane J. Cook,et al.  Keeping the Resident in the Loop: Adapting the Smart Home to the User , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[53]  J. Barbenel,et al.  The efficacy of an intelligent cognitive orthosis to facilitate handwashing by persons with moderate to severe dementia , 2004 .

[54]  Oliver Brdiczka,et al.  Detecting Individual Activities from Video in a Smart Home , 2007, KES.

[55]  Inge Jonassen,et al.  Fast Sequence Clustering Using A Suffix Array Algorithm , 2003, Bioinform..

[56]  Ping-Yu Hsu,et al.  Mining hybrid sequential patterns and sequential rules , 2002, Inf. Syst..

[57]  Mohammed J. Zaki,et al.  ADMIT: anomaly-based data mining for intrusions , 2002, KDD.

[58]  William C. Mann,et al.  The Gator Tech Smart House: a programmable pervasive space , 2005, Computer.

[59]  David Taniar,et al.  Computational Science and Its Applications - ICCSA 2005, International Conference, Singapore, May 9-12, 2005, Proceedings, Part I , 2005, ICCSA.

[60]  Qiming Chen,et al.  PrefixSpan,: mining sequential patterns efficiently by prefix-projected pattern growth , 2001, Proceedings 17th International Conference on Data Engineering.

[61]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .