Recognizing water-based activities in the home through infrastructure-mediated sensing

Activity recognition in the home has been long recognized as the foundation for many desirable applications in fields such as home automation, sustainability, and healthcare. However, building a practical home activity monitoring system remains a challenge. Striking a balance between cost, privacy, ease of installation and scalability continues to be an elusive goal. In this paper, we explore infrastructure-mediated sensing combined with a vector space model learning approach as the basis of an activity recognition system for the home. We examine the performance of our single-sensor water-based system in recognizing eleven high-level activities in the kitchen and bathroom, such as cooking and shaving. Results from two studies show that our system can estimate activities with overall accuracy of 82.69% for one individual and 70.11% for a group of 23 participants. As far as we know, our work is the first to employ infrastructure-mediated sensing for inferring high-level human activities in a home setting.

[1]  S. Katz.  Studies of illness in the aged , 1963 .

[2]  Rama Chellappa,et al.  Machine Recognition of Human Activities: A Survey , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  James Fogarty,et al.  Sensing from the basement: a feasibility study of unobtrusive and low-cost home activity recognition , 2006, UIST.

[4]  M. Lawton,et al.  Assessment of Older People: Self-Maintaining and Instrumental Activities of Daily Living , 1969 .

[5]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[6]  Cordelia Schmid,et al.  Evaluation of Local Spatio-temporal Features for Action Recognition , 2009, BMVC.

[7]  Eric C. Larson,et al.  GasSense: Appliance-Level, Single-Point Sensing of Gas Activity in the Home , 2010, Pervasive.

[8]  Guang-Zhong Yang,et al.  The use of pervasive sensing for behaviour profiling - a survey , 2009, Pervasive Mob. Comput..

[9]  Kent Larson,et al.  Using a Live-In Laboratory for Ubiquitous Computing Research , 2006, Pervasive.

[10]  Context-Aware Computing,et al.  Inferring Activities from Interactions with Objects , 2004 .

[11]  Les E. Atlas,et al.  A Longitudinal Study of Pressure Sensing to Infer Real-World Water Usage Events in the Home , 2011, Pervasive.

[12]  Gregory D. Abowd,et al.  Detecting Human Movement by Differential Air Pressure Sensing in HVAC System Ductwork: An Exploration in Infrastructure Mediated Sensing , 2009, Pervasive.

[13]  Irfan A. Essa,et al.  A novel sequence representation for unsupervised analysis of human activities , 2009, Artif. Intell..

[14]  Eric C. Larson,et al.  HydroSense: infrastructure-mediated single-point sensing of whole-home water activity , 2009, UbiComp.

[15]  Shwetak N. Patel,et al.  ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home , 2010, UbiComp.

[16]  Aaron F. Bobick,et al.  Recognition of Visual Activities and Interactions by Stochastic Parsing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  M. Csíkszentmihályi,et al.  The Experience Sampling Method , 2014 .

[18]  Patrick Olivier,et al.  Slice&Dice: Recognizing Food Preparation Activities Using Embedded Accelerometers , 2009, AmI.

[19]  Elaine B. Hyder,et al.  The ELDer project: social, emotional, and environmental factors in the design of eldercare technologies , 2000, CUU '00.

[20]  Irfan A. Essa,et al.  Recognizing multitasked activities from video using stochastic context-free grammar , 2002, AAAI/IAAI.

[21]  Albrecht Schmidt,et al.  Context-aware kitchen utilities , 2007, Tangible and Embedded Interaction.

[22]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[23]  Gregory D. Abowd,et al.  The Georgia Tech aware home , 2008, CHI Extended Abstracts.

[24]  Gerard Salton,et al.  The SMART Retrieval System—Experiments in Automatic Document Processing , 1971 .

[25]  Joel M. Hektner,et al.  Experience sampling method , 2007 .