Sensor Fusion for Recognition of Activities of Daily Living

Activity of daily living (ADL) is a significant predictor of the independence and functional capabilities of an individual. Measurements of ADLs help to indicate one’s health status and capabilities of quality living. Recently, the most common ways to capture ADL data are far from automation, including a costly 24/7 observation by a designated caregiver, self-reporting by the user laboriously, or filling out a written ADL survey. Fortunately, ubiquitous sensors exist in our surroundings and on electronic devices in the Internet of Things (IoT) era. We proposed the ADL Recognition System that utilizes the sensor data from a single point of contact, such as smartphones, and conducts time-series sensor fusion processing. Raw data is collected from the ADL Recorder App constantly running on a user’s smartphone with multiple embedded sensors, including the microphone, Wi-Fi scan module, heading orientation of the device, light proximity, step detector, accelerometer, gyroscope, magnetometer, etc. Key technologies in this research cover audio processing, Wi-Fi indoor positioning, proximity sensing localization, and time-series sensor data fusion. By merging the information of multiple sensors, with a time-series error correction technique, the ADL Recognition System is able to accurately profile a person’s ADLs and discover his life patterns. This paper is particularly concerned with the care for the older adults who live independently.

[1]  Gregory J Welk,et al.  Comparison of Consumer and Research Monitors under Semistructured Settings. , 2016, Medicine and science in sports and exercise.

[2]  Abdullah Talha Kabakus,et al.  A performance evaluation of in-memory databases , 2017, J. King Saud Univ. Comput. Inf. Sci..

[3]  Heinrich C. Mayr,et al.  A windowing approach for activity recognition in sensor data streams , 2016, 2016 Eighth International Conference on Ubiquitous and Future Networks (ICUFN).

[4]  Eeti Jain,et al.  Performance comparision of Hadoop and spark engine , 2017, 2017 International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC).

[5]  James M. Lucas,et al.  Exponentially weighted moving average control schemes: Properties and enhancements , 1990 .

[6]  M. Lawton,et al.  Assessment of older people: self-maintaining and instrumental activities of daily living. , 1969, The Gerontologist.

[7]  Carl K. Chang,et al.  Recognizing Activities of Daily Living to Improve Well-Being , 2017, IT Professional.

[8]  Tony J. Dodd,et al.  Multi-sensor data fusion in defence and aerospace , 1998, The Aeronautical Journal (1968).

[9]  Ilkka Korhonen,et al.  Detection of Daily Activities and Sports With Wearable Sensors in Controlled and Uncontrolled Conditions , 2008, IEEE Transactions on Information Technology in Biomedicine.

[10]  Peter Talty,et al.  Assessing the Elderly: A Practical Guide to Measurement , 1983 .

[11]  M. Amaç Güvensan,et al.  Discriminative time-domain features for activity recognition on a mobile phone , 2014, 2014 IEEE Ninth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP).

[12]  Gary M. Weiss,et al.  Activity recognition using cell phone accelerometers , 2011, SKDD.

[13]  Duc A. Tran,et al.  The 11th International Conference on Mobile Systems and Pervasive Computing (MobiSPC-2014) A Study on Human Activity Recognition Using Accelerometer Data from Smartphones , 2014 .

[14]  Angelo M. Sabatini,et al.  Machine Learning Methods for Classifying Human Physical Activity from On-Body Accelerometers , 2010, Sensors.

[15]  Ling Bao,et al.  Activity Recognition from User-Annotated Acceleration Data , 2004, Pervasive.

[16]  Yunfei Feng,et al.  Global Wi-Fi Positioning Method Based on Online Clustering Algorithm , 2018, 2018 4th International Conference on Big Data Computing and Communications (BIGCOM).

[17]  Nuno M. Garcia,et al.  Identification of Activities of Daily Living Using Sensors Available in off-the-shelf Mobile Devices: Research and Hypothesis , 2016, ISAmI.

[18]  G. Fillenbaum,et al.  The wellbeing of the elderly. Approaches to multidimensional assessment. , 1984, WHO offset publication.

[19]  Robert X. Gao,et al.  Multi-Sensor Ensemble Classifier for Activity Recognition , 2012 .

[20]  Carl K. Chang,et al.  An ADL Recognition System on Smart Phone , 2016, ICOST.

[21]  Weihua Sheng,et al.  Human daily activity recognition in robot-assisted living using multi-sensor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[22]  Nuno M. Garcia,et al.  From Data Acquisition to Data Fusion: A Comprehensive Review and a Roadmap for the Identification of Activities of Daily Living Using Mobile Devices , 2016, Sensors.

[23]  N. Garcia,et al.  Multi-sensor data fusion techniques for the identification of activities of daily living using mobile devices , 2015 .

[24]  Carl K. Chang,et al.  Guest Editorial: A Roadmap for Mobile and Cloud Services for Digital Health , 2018, IEEE Trans. Serv. Comput..

[25]  Arthur D. Fisk,et al.  Functional Limitations to Daily Living Tasks in the Aged: A Focus Group Analysis , 1998, Hum. Factors.

[26]  Johannes Peltola,et al.  Activity classification using realistic data from wearable sensors , 2006, IEEE Transactions on Information Technology in Biomedicine.

[27]  Yan Huang,et al.  On the Design of a Wearable Multi-sensor System for Recognizing Motion Modes and Sit-to-stand Transition , 2014 .

[28]  Kent Larson,et al.  Activity Recognition in the Home Using Simple and Ubiquitous Sensors , 2004, Pervasive.