Low-cost and Device-free Activity Recognition System with Energy Harvesting PIR and Door Sensors

Progress of IoT and ubiquitous computing technologies has strong anticipation to realize smart services in households such as efficient energy-saving appliance control and elderly monitoring. In order to put those applications into practice, high-accuracy and low-cost in-home living activity recognition is essential. Many researches have tackled living activity recognition so far, but the following problems remain: (i)privacy exposure due to utilization of cameras and microphones; (ii) high deployment and maintenance costs due to many sensors used; (iii) burden to force the user to carry the device and (iv) wire installation to supply power and communication between sensor node and server; (v) few recognizable activities; (vi) low recognition accuracy. In this paper, we propose an in-home living activity recognition method to solve all the problems. To solve the problems (i)--(iv), our method utilizes only energy harvesting PIR and door sensors with a home server for data collection and processing. The energy harvesting sensor has a solar cell to drive the sensor and wireless communication modules. To solve the problems (v) and (vi), we have tackled the following challenges: (a) determining appropriate features for training samples; and (b) determining the best machine learning algorithm to achieve high recognition accuracy; (c) complementing the dead zone of PIR sensor semipermanently. We have conducted experiments with the sensor by five subjects living in a home for 2-3 days each. As a result, the proposed method has achieved F-measure: 62.8% on average.

[1]  Sung-Ho Kim,et al.  Emergency Situation Alarm System Motion Using Tracking of People like Elderly Live Alone , 2013, 2013 International Conference on Information Science and Applications (ICISA).

[2]  John Krumm,et al.  PreHeat: controlling home heating using occupancy prediction , 2011, UbiComp '11.

[3]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[4]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[5]  Hirozumi Yamaguchi,et al.  Survey of Real-time Processing Technologies of IoT Data Streams , 2016, J. Inf. Process..

[6]  Nikolaos Papanikolopoulos,et al.  Multi-Camera Human Activity Monitoring , 2008, J. Intell. Robotic Syst..

[7]  Kenji Mase,et al.  Activity and Location Recognition Using Wearable Sensors , 2002, IEEE Pervasive Comput..

[8]  Prashant J. Shenoy,et al.  SmartCap: Flattening peak electricity demand in smart homes , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[9]  Keiichi Yasumoto,et al.  A method for recognizing living activities in homes using positioning sensor and power meters , 2015, 2015 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[10]  Miguel A. Labrador,et al.  A Survey on Human Activity Recognition using Wearable Sensors , 2013, IEEE Communications Surveys & Tutorials.

[11]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[12]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.

[13]  Jesse Hoey,et al.  Value-Directed Human Behavior Analysis from Video Using Partially Observable Markov Decision Processes , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.