Fuzzy association rule mining for recognising daily activities using Kinect sensors and a single power meter

The recognition of activities of daily living (ADLs) by home monitoring systems can be helpful in order to objectively assess the health-related living behaviour and functional ability of older adults. Many ADLs involve human interactions with household electrical appliances (HEAs) such as toasters and hair dryers. Advances in sensor technology have prompted the development of intelligent algorithms to recognise ADLs via inferential information provided from the use of HEAs. The use of robust unsupervised machine learning techniques with inexpensive and retrofittable sensors is an ongoing focus in the ADL recognition research. This paper presents a novel unsupervised activity recognition method for elderly people living alone. This approach exploits a fuzzy-based association rule-mining algorithm to identify the home occupant’s interactions with HEAs using a power sensor, retrofitted at the house electricity panel, and a few Kinect sensors deployed at various locations within the home. A set of fuzzy rules is learned automatically from unlabelled sensor data to map the occupant’s locations during ADLs to the power signatures of HEAs. The fuzzy rules are then used to classify ADLs in new sensor data. Evaluations in real-world settings in this study demonstrated the potential of using Kinect sensors in conjunction with a power meter for the recognition of ADLs. This method was found to be significantly more accurate than just using power consumption data. In addition, the evaluation results confirmed that, owing to the use of fuzzy logic, the proposed method tolerates real-life variations in ADLs where the feature values in new sensor data differ slightly from those in the learning patterns.

[1]  Jian Lu,et al.  epSICAR: An Emerging Patterns based approach to sequential, interleaved and Concurrent Activity Recognition , 2009, 2009 IEEE International Conference on Pervasive Computing and Communications.

[2]  Man Hon Wong,et al.  Mining fuzzy association rules in databases , 1998, SGMD.

[3]  Adrian D. C. Chan,et al.  Usage monitoring of electrical devices in a smart home , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Jun Jiang,et al.  Remote Safety Monitoring for Elderly Persons Based on Omni-Vision Analysis , 2015, PloS one.

[5]  Fabio Ramos,et al.  Multi-scale Conditional Random Fields for first-person activity recognition on elders and disabled patients , 2015 .

[6]  Jarrett Webb,et al.  Beginning Kinect Programming with the Microsoft Kinect SDK , 2012, Apress.

[7]  Koen Milisen,et al.  Attitudes and perceptions of adults of 60 years and older towards in-home monitoring of the activities of daily living with contactless sensors: an explorative study. , 2014, International journal of nursing studies.

[8]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[9]  Kamin Whitehouse,et al.  FixtureFinder: Discovering the existence of electrical and water fixtures , 2013, 2013 ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN).

[10]  Susan Elias,et al.  Probabilistic ontology based activity recognition in smart homes using Markov Logic Network , 2017, Knowl. Based Syst..

[11]  Chris D. Nugent,et al.  A Knowledge-Driven Approach to Activity Recognition in Smart Homes , 2012, IEEE Transactions on Knowledge and Data Engineering.

[12]  Chris D. Nugent,et al.  From Activity Recognition to Intention Recognition for Assisted Living Within Smart Homes , 2017, IEEE Transactions on Human-Machine Systems.

[13]  Abdenour Bouzouane,et al.  An efficient and inexpensive method for activity recognition within a smart home based on load signatures of appliances , 2014, Pervasive Mob. Comput..

[14]  Pau-Choo Chung,et al.  A daily behavior enabled hidden Markov model for human behavior understanding , 2008, Pattern Recognit..

[15]  Zoran A. Salcic,et al.  Enhancing ontological reasoning with uncertainty handling for activity recognition , 2016, Knowl. Based Syst..

[16]  Subhas Mukhopadhyay,et al.  Intelligent Sensing Systems for Measuring Wellness Indices of the Daily Activities for the Elderly , 2012, 2012 Eighth International Conference on Intelligent Environments.

[17]  Yeh-Liang Hsu,et al.  Remote monitoring and assessment of daily activities in the home environment , 2012 .

[18]  T. Kirste,et al.  Computational State Space Models for Activity and Intention Recognition. A Feasibility Study , 2014, PloS one.

[19]  Homay Danaei Mehr,et al.  Resident activity recognition in smart homes by using artificial neural networks , 2016, 2016 4th International Istanbul Smart Grid Congress and Fair (ICSG).

[20]  Y. M. Huang,et al.  Pervasive, secure access to a hierarchical sensor-based healthcare monitoring architecture in wireless heterogeneous networks , 2009, IEEE Journal on Selected Areas in Communications.

[21]  A. Dey World report on ageing and health , 2017, The Indian Journal of Medical Research.

[22]  M. Berenguer,et al.  Automatic detection of activities of daily living from detecting and classifying electrical events on the residential power line , 2008, HealthCom 2008 - 10th International Conference on e-health Networking, Applications and Services.

[23]  Tomasz Imielinski,et al.  Mining association rules between sets of items in large databases , 1993, SIGMOD Conference.

[24]  Majid Mirmehdi,et al.  Recognition of unscripted kitchen activities and eating behaviour for health monitoring , 2016 .

[25]  Heidrun Schumann,et al.  Supporting activity recognition by visual analytics , 2015, 2015 IEEE Conference on Visual Analytics Science and Technology (VAST).

[26]  Klaus Kabitzsch,et al.  Detecting Activities of Daily Living with Smart Meters , 2014 .

[27]  Dragan Kukolj,et al.  Design of adaptive Takagi-Sugeno-Kang fuzzy models , 2002, Appl. Soft Comput..

[28]  Tatsuya Yamazaki,et al.  AERO: extraction of user's activities from electric power consumption data , 2010, IEEE Transactions on Consumer Electronics.

[29]  Diane J. Cook,et al.  Activity recognition on streaming sensor data , 2014, Pervasive Mob. Comput..

[30]  Michel Giordani,et al.  Building an Index of Activity of Inhabitants From Their Activity on the Residential Electrical Power Line , 2011, IEEE Transactions on Information Technology in Biomedicine.

[31]  Gourab Sen Gupta,et al.  Elder Care Based on Cognitive Sensor Network , 2011, IEEE Sensors Journal.