Toward real-time in-home activity recognition using indoor positioning sensor and power meters

Automatic recognition of activities of daily living (ADL) can be applied to realize services to support user life such as elderly monitoring, energy-saving home appliance control, and health support. In particular, “real-time” ADL recognition is essential to realize such a service that the system needs to know the user's current activity. There are many studies on ADL recognition. However, none of these studies address all of the following problems: (1) privacy intrusion due to the utilization of high privacy-invasive devices such as cameras and microphones; (2) limited number of recognizable activities; (3) low recognition accuracy; (4) high deployment and maintenance costs due to many sensors used; and (5) long recognition time. In our prior work, we proposed a system which solves the problems (1)– (4) to some extent by using user's position data and power consumption data of home electric appliances. In this paper, aiming to solve all the above problems including (5), we propose a new system by extending our prior work. To realize “real-time” ADL recognition while keeping good recognition accuracy, we developed new power meters with higher sensing frequency and introduced new techniques such as adding new features, selecting the best subset of the features, and selecting the best training dataset used for machine learning. We collected the sensor data in our smart home facility for 11 days, and applied the proposed method to these sensor data. As a result, the proposed method achieved accuracy of 79.393% in recognizing 10 types of ADLs.

[1]  Yutaka Arakawa,et al.  Exploring Accuracy-Cost Tradeoff in In-Home Living Activity Recognition Based on Power Consumptions and User Positions , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[2]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[3]  John Krumm,et al.  PreHeat: controlling home heating using occupancy prediction , 2011, UbiComp '11.

[4]  Miwako Doi,et al.  Smartphone-based monitoring system for activities of daily living for elderly people and their relatives etc. , 2013, UbiComp.

[5]  Simon A. Dobson,et al.  USMART , 2014, ACM Trans. Interact. Intell. Syst..

[6]  Alex Mihailidis,et al.  A Survey on Ambient-Assisted Living Tools for Older Adults , 2013, IEEE Journal of Biomedical and Health Informatics.

[7]  Oliver Brdiczka,et al.  Detecting Human Behavior Models From Multimodal Observation in a Smart Home , 2009, IEEE Transactions on Automation Science and Engineering.

[8]  Shwetak N. Patel,et al.  ElectriSense: single-point sensing using EMI for electrical event detection and classification in the home , 2010, UbiComp.

[9]  Prashant J. Shenoy,et al.  SmartCap: Flattening peak electricity demand in smart homes , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[10]  Majid Sarrafzadeh,et al.  Monitoring eating habits using a piezoelectric sensor-based necklace , 2015, Comput. Biol. Medicine.

[11]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[12]  Timo Sztyler,et al.  Unsupervised recognition of interleaved activities of daily living through ontological and probabilistic reasoning , 2016, UbiComp.

[13]  Takuya Maekawa,et al.  Recognizing the Use of Portable Electrical Devices with Hand-Worn Magnetic Sensors , 2011, Pervasive.

[14]  Michel Vacher,et al.  SVM-Based Multimodal Classification of Activities of Daily Living in Health Smart Homes: Sensors, Algorithms, and First Experimental Results , 2010, IEEE Transactions on Information Technology in Biomedicine.

[15]  Gwenn Englebienne,et al.  An activity monitoring system for elderly care using generative and discriminative models , 2010, Personal and Ubiquitous Computing.