SALON: Simplified Sensing System for Activity of Daily Living in Ordinary Home

As aging populations continue to grow, primarily in developed countries, there are increasing demands for the system that monitors the activities of elderly people while continuing to allow them to pursue their individual, healthy, and independent lifestyles. Therefore, it is required to develop the activity of daily living (ADL) sensing systems that are based on high-performance sensors and information technologies. However, most of the systems that have been proposed to date have only been investigated and/or evaluated in experimental environments. When considering the spread of such systems to typical homes inhabited by elderly people, it is clear that such sensing systems will need to meet the following five requirements: (1) be inexpensive; (2) provide robustness; (3) protect privacy; (4) be maintenance-free; and, (5) work with a simple user interface. In this paper, we propose a novel senior-friendly ADL sensing system that can fulfill these requirements. More specifically, we achieve an easy collection of ADL data from elderly people while using a proposed system that consists of a small number of inexpensive energy harvesting sensors and simple annotation buttons, without the need for privacy-invasive cameras or microphones. In order to evaluate the practicality of our proposed system, we installed it in ten typical homes with elderly residents and collected the ADL data over a two-month period. We then visualized the collected data and performed activity recognition using a long short-term memory (LSTM) model. From the collected results, we confirmed that our proposed system, which is inexpensive and non-invasive, can correctly collect resident ADL data and could recognize activities from the collected data with a high recall rate of 72.3% on average. This result shows a high potential of our proposed system for application to services for elderly people.

[1]  Yutaka Arakawa,et al.  Daily living activity recognition with ECHONET Lite appliances and motion sensors , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[2]  Wei Wang,et al.  Understanding and Modeling of WiFi Signal Based Human Activity Recognition , 2015, MobiCom.

[3]  Adesh Kumar,et al.  Wireless Sensor Network Based Smart Grid Communications: Cyber Attacks, Intrusion Detection System and Topology Control , 2017 .

[4]  Diane J. Cook,et al.  CASAS: A Smart Home in a Box , 2013, Computer.

[5]  Álvaro Hernández,et al.  Assessing Human Activity in Elderly People Using Non-Intrusive Load Monitoring , 2017, Sensors.

[6]  Yutaka Arakawa,et al.  Toward real-time in-home activity recognition using indoor positioning sensor and power meters , 2017, 2017 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[7]  Yuan-Ting Zhang,et al.  A Novel Secure IoT-Based Smart Home Automation System Using a Wireless Sensor Network , 2016, Sensors.

[8]  Gregory M. P. O'Hare,et al.  Dynamic sensor event segmentation for real-time activity recognition in a smart home context , 2014, Personal and Ubiquitous Computing.

[9]  Özlem Durmaz Incel,et al.  ARAS human activity datasets in multiple homes with multiple residents , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[10]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[11]  Patricia Sánchez González,et al.  iCarer Project: Intelligent Care Guidance and Learning Services Platform for Informal Carers of the Elderly , 2014 .

[12]  S. Katz,et al.  STUDIES OF ILLNESS IN THE AGED. THE INDEX OF ADL: A STANDARDIZED MEASURE OF BIOLOGICAL AND PSYCHOSOCIAL FUNCTION. , 1963, JAMA.

[13]  T. Robinson,et al.  Sustainable Development Goals , 2016 .

[14]  Brigitte Meillon,et al.  The Sweet-Home speech and multimodal corpus for home automation interaction , 2014, LREC.

[15]  Hirohiko Suwa,et al.  Easy-to-Deploy Living Activity Sensing System and Data Collection in General Homes , 2020, 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).

[16]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.

[17]  Hongnian Yu,et al.  Elderly activities recognition and classification for applications in assisted living , 2013, Expert Syst. Appl..

[18]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.

[19]  Niall Twomey,et al.  Unsupervised learning of sensor topologies for improving activity recognition in smart environments , 2017, Neurocomputing.

[20]  Elfed Lewis,et al.  FPGA based Real time 'secure' body temperature monitoring suitable for WBSN 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing , 2015 .

[21]  Daniel Roggen,et al.  Deep Convolutional and LSTM Recurrent Neural Networks for Multimodal Wearable Activity Recognition , 2016, Sensors.

[22]  Hans-Georg Kemper,et al.  Application-Pull and Technology-Push as Driving Forces for the Fourth Industrial Revolution , 2014 .

[23]  Antonio Casimiro,et al.  A Survey on Data Quality for Dependable Monitoring in Wireless Sensor Networks , 2017, Sensors.

[24]  Neil W. Bergmann,et al.  IoT Privacy and Security Challenges for Smart Home Environments , 2016, Inf..

[25]  Yutaka Arakawa,et al.  Exploring Accuracy-Cost Tradeoff in In-Home Living Activity Recognition Based on Power Consumptions and User Positions , 2015, 2015 IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing.

[26]  Shyamnath Gollakota,et al.  Bringing Gesture Recognition to All Devices , 2014, NSDI.

[27]  Milton Gonzalo Ruiz Maldonado Wireless Sensor Network for Smart Home Services Using Optimal Communications , 2017, 2017 International Conference on Information Systems and Computer Science (INCISCOS).

[28]  Xiaohui Peng,et al.  Deep Learning for Sensor-based Activity Recognition: A Survey , 2017, Pattern Recognit. Lett..

[29]  Niall Twomey,et al.  Releasing eHealth Analytics into the Wild: Lessons Learnt from the SPHERE Project , 2018, KDD.

[30]  Diane J. Cook,et al.  Smart home in a box: usability study for a large scale self-installation of smart home technologies , 2016, Journal of Reliable Intelligent Environments.

[31]  Daniel Gatica-Perez,et al.  Anomaly Detection in Elderly Daily Behavior in Ambient Sensing Environments , 2016, HBU.

[32]  Robert Simon Sherratt,et al.  SPW-1: A Low-Maintenance Wearable Activity Tracker for Residential Monitoring and Healthcare Applications , 2016, eHealth 360°.

[33]  Keiichi Yasumoto,et al.  Decision making support for privacy data upload in smart home , 2019, UbiComp/ISWC Adjunct.

[34]  Robert J. Piechocki,et al.  Vesta: A digital health analytics platform for a smart home in a box , 2021, Future Gener. Comput. Syst..

[35]  Osamah Ibrahim Khalaf,et al.  An adaptive intelligent alarm system for wireless sensor network , 2019, Indonesian Journal of Electrical Engineering and Computer Science.

[36]  Dina S. Deif,et al.  A comprehensive wireless sensor network reliability metric for critical Internet of Things applications , 2017, EURASIP J. Wirel. Commun. Netw..

[37]  Yutaka Arakawa,et al.  ALPAS: Analog-PIR-Sensor-Based Activity Recognition System in Smarthome , 2017, 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA).

[38]  George Loukas,et al.  Activity Recognition in a Home Setting Using Off the Shelf Smart Watch Technology , 2016, 2016 15th International Conference on Ubiquitous Computing and Communications and 2016 International Symposium on Cyberspace and Security (IUCC-CSS).

[39]  Yutaka Arakawa,et al.  Sensing Activities and Locations of Senior Citizens toward Automatic Daycare Report Generation , 2017, 2017 IEEE 31st International Conference on Advanced Information Networking and Applications (AINA).

[40]  Simon A. Dobson,et al.  Situation identification techniques in pervasive computing: A review , 2012, Pervasive Mob. Comput..

[41]  Arvind D. Shaligram,et al.  An Investigative Study for Smart Home Security: Issues, Challenges and Countermeasures , 2016 .

[42]  Kevin Bouchard,et al.  Exploiting Passive RFID Technology for Activity Recognition in Smart Homes , 2015, IEEE Intelligent Systems.

[43]  Subhas Chandra Mukhopadhyay,et al.  Wireless sensors network based safe home to care elderly people: behaviour detection , 2011 .

[44]  Ahmad Lotfi,et al.  Smart homes for the elderly dementia sufferers: identification and prediction of abnormal behaviour , 2012, J. Ambient Intell. Humaniz. Comput..

[45]  Miguel Hernando,et al.  Home Camera-Based Fall Detection System for the Elderly , 2017, Sensors.

[46]  Julien Pinquier,et al.  Water sound recognition based on physical models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[47]  J O'gradyMichael,et al.  Dynamic sensor event segmentation for real-time activity recognition in a smart home context , 2015 .

[48]  Claudia Jiménez-Guarín,et al.  The ContextAct@A4H Real-Life Dataset of Daily-Living Activities - Activity Recognition Using Model Checking , 2017, CONTEXT.

[49]  Robert Steele,et al.  Elderly persons' perception and acceptance of using wireless sensor networks to assist healthcare , 2009, Int. J. Medical Informatics.

[50]  Abdulsalam Yassine,et al.  Mining Human Activity Patterns From Smart Home Big Data for Health Care Applications , 2017, IEEE Access.

[51]  Tatsuya Harada,et al.  Recognizing Activities of Daily Living with a Wrist-Mounted Camera , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  Yutaka Arakawa,et al.  Beacon-Based Time-Spatial Recognition toward Automatic Daily Care Reporting for Nursing Homes , 2018, J. Sensors.

[53]  Diane J. Cook,et al.  Ambient and smartphone sensor assisted ADL recognition in multi-inhabitant smart environments , 2016, J. Ambient Intell. Humaniz. Comput..

[54]  David Wetherall,et al.  Recognizing daily activities with RFID-based sensors , 2009, UbiComp.

[55]  Gregory D. Abowd,et al.  Recognizing water-based activities in the home through infrastructure-mediated sensing , 2012, UbiComp '12.

[56]  Itu Snigdh,et al.  Evaluating Quasi Random Deployment in Zigbee Based Wireless Sensor Networks , 2019 .

[57]  Sajal K. Das,et al.  Multimodal Wearable Sensing for Fine-Grained Activity Recognition in Healthcare , 2015, IEEE Internet Computing.

[58]  Juan Carlos Augusto,et al.  A Formal Methodology to Design and Deploy Dependable Wireless Sensor Networks , 2016, Sensors.

[59]  Gwenn Englebienne,et al.  Accurate activity recognition in a home setting , 2008, UbiComp.

[60]  Ruijiao Li,et al.  Cognitive assisted living ambient system: a survey , 2015, Digit. Commun. Networks.

[61]  Jacques M. Bahi,et al.  Dependability of wireless sensor networks for industrial prognostics and health management , 2015, Comput. Ind..

[62]  Jian Lu,et al.  Recognizing multi-user activities using wearable sensors in a smart home , 2011, Pervasive Mob. Comput..

[63]  Kiichi Kubota Expectation and a problem to The 5th Science and Technology Basic Plan , 2016 .

[64]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.