Exploring Accuracy-Cost Tradeoff in In-Home Living Activity Recognition Based on Power Consumptions and User Positions

Advanced context-aware services at home such as elderly monitoring requires highly accurate living activity recognition in a home environment. Existing studies on living activity recognition suffer from high deployment and maintenance costs, privacy intrusion due to utilization of cameras and microphones, and few recognizable activities or low recognition accuracy. In this paper, to solve these problems, we propose a new living activity recognition method. Our method utilizes only power meters attached to appliances and a positioning sensor attached to a resident of a home to mitigate privacy intrusion. We target 10 different living activities which cover most of our daily lives at home and construct activity recognition models based on machine-leaning. To accurately recognize the activities from the sensor data by power meters and position sensor, we explore the best combination of time window width for samples of training/test data, features, and machine-learning algorithms. Furthermore, we thoroughly investigate the tradeoff between the sensor data granularity and the consequent recognition accuracy. Through experiments using sensor data collected by four participants in our smart home, the proposed method achieved 97.8% average F-measure of recognizing 10 target activities with the finest sensor data granularity (position estimation error ≤ 0.1m, 16 power meters) and 86.9 % F-measure with room-level position accuracy and one power meter for each of four rooms.

[1]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[2]  Jesse Hoey,et al.  Value-Directed Human Behavior Analysis from Video Using Partially Observable Markov Decision Processes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Takuya Maekawa,et al.  Recognizing the Use of Portable Electrical Devices with Hand-Worn Magnetic Sensors , 2011, Pervasive.

[4]  Ig-Jae Kim,et al.  Automatic Lifelog media annotation based on heterogeneous sensor fusion , 2008, 2008 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems.

[5]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[6]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[7]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[8]  Sung-Ho Kim,et al.  Emergency Situation Alarm System Motion Using Tracking of People like Elderly Live Alone , 2013, 2013 International Conference on Information Science and Applications (ICISA).

[9]  John Krumm,et al.  PreHeat: controlling home heating using occupancy prediction , 2011, UbiComp '11.

[10]  Jo Vermeulen,et al.  From today's augmented houses to tomorrow's smart homes: new directions for home automation research , 2014, UbiComp.

[11]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[12]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[13]  Yongcai Wang,et al.  Accurate Location Stream Tracking and Recognition Using an Ultrasound Localization System , 2011 .

[14]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[15]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[16]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[17]  Prashant J. Shenoy,et al.  SmartCap: Flattening peak electricity demand in smart homes , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[18]  Sarvapali D. Ramchurn,et al.  Understanding domestic energy consumption through interactive visualisation: a field study , 2012, UbiComp.

[19]  Keiichi Yasumoto,et al.  A method for recognizing living activities in homes using positioning sensor and power meters , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[20]  Gregory D. Abowd,et al.  Recognizing water-based activities in the home through infrastructure-mediated sensing , 2012, UbiComp '12.