Annotating smart environment sensor data for activity learning.

The pervasive sensing technologies found in smart homes offer unprecedented opportunities for providing health monitoring and assistance to individuals experiencing difficulties living independently at home. In order to monitor the functional health of smart home residents, we need to design technologies that recognize and track the activities that people perform at home. Machine learning techniques can perform this task, but the software algorithms rely upon large amounts of sample data that is correctly labeled with the corresponding activity. Labeling, or annotating, sensor data with the corresponding activity can be time consuming, may require input from the smart home resident, and is often inaccurate. Therefore, in this paper we investigate four alternative mechanisms for annotating sensor data with a corresponding activity label. We evaluate the alternative methods along the dimensions of annotation time, resident burden, and accuracy using sensor data collected in a real smart apartment.

[1]  Daniel P. Siewiorek,et al.  Activity recognition and monitoring using multiple sensors on different body positions , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[2]  Henry A. Kautz,et al.  An Overview of the Assisted Cognition Project , 2002 .

[3]  O. Okonkwo,et al.  Mild cognitive impairment and everyday function: evidence of reduced speed in performing instrumental activities of daily living. , 2008, The American journal of geriatric psychiatry : official journal of the American Association for Geriatric Psychiatry.

[4]  Donald E. Brown,et al.  Health-status monitoring through analysis of behavioral patterns , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[6]  B. Kröse,et al.  Bayesian Activity Recognition in Residence for Elders , 2007 .

[7]  Vincent Rialle,et al.  What Do Family Caregivers of Alzheimer’s Disease Patients Desire in Smart Home Technologies? , 2009, Methods of Information in Medicine.

[8]  Diane J. Cook,et al.  Inhabitant Guidance of Smart Environments , 2007, HCI.

[9]  Henry A. Kautz,et al.  Location-Based Activity Recognition using Relational Markov Networks , 2005, IJCAI.

[10]  J. Barbenel,et al.  The efficacy of an intelligent cognitive orthosis to facilitate handwashing by persons with moderate to severe dementia , 2004 .

[11]  Oliver Brdiczka,et al.  Detecting Individual Activities from Video in a Smart Home , 2007, KES.

[12]  Diane J. Cook,et al.  Data Mining for Hierarchical Model Creation , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[13]  Martha E. Pollack,et al.  Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment , 2005, AI Mag..

[14]  B. Reisberg,et al.  The Alzheimer's Disease Activities of Daily Living International Scale (ADL-IS) , 2001, International Psychogeriatrics.

[15]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Emmanuel Munguia Tapia,et al.  Toward Scalable Activity Recognition for Sensor Networks , 2006, LoCA.

[17]  Karen L. Courtney,et al.  Brief Review: Defining Obtrusiveness in Home Telehealth Technologies: A Conceptual Framework , 2006, J. Am. Medical Informatics Assoc..

[18]  Context-Aware Computing,et al.  Inferring Activities from Interactions with Objects , 2004 .

[19]  Diane J. Cook,et al.  Smart environments - technology, protocols and applications , 2004 .

[20]  H. Damasio,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence: Special Issue on Perceptual Organization in Computer Vision , 1998 .

[21]  Gregory D. Abowd,et al.  Designing for the Human Experience in Smart Environments , 2005 .

[22]  Jesús Favela,et al.  Activity Recognition for the Smart Hospital , 2008, IEEE Intelligent Systems.

[23]  William C. Mann,et al.  The Gator Tech Smart House: a programmable pervasive space , 2005, Computer.

[24]  Hani Hagras,et al.  A fuzzy embedded agent-based approach for realizing ambient intelligence in intelligent inhabited environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[25]  John E. Laird,et al.  Variability in Human Behavior Modeling for Military Simulations , 2003 .

[26]  Ian Witten,et al.  Data Mining , 2000 .