ADLs Monitoring by Accelerometer-Based Wearable Sensors: Effect of Measurement Device and Data Uncertainty on Classification Accuracy

Machine Learning algorithms are often used for automatic recognition and classification of Activities of Daily Living, and they rely on the computation of several features capturing the relevant characteristics of the collected signals, either in the time and frequency domains. While the accuracy of the measurement device used may be assessed by the manufacturer’s specifications or by specific tests, the propagated uncertainty of the computed features is typically not considered in the framework of automatic classification approaches. In this paper, the impact of the measurement devices on data quality, and consequently on the performance of automatic classifiers, is evaluated, in the context of accelerometer-based recognition of Activities of Daily Living with a wrist-worn device. Results show that different accuracy performance may be attained in the classification process, depending on the wearable device used, despite the same environmental and operational conditions.

[1]  Kai Zhou,et al.  A Behavior Recognition Framework Based on Skeleton Spatio-Temporal Relation , 2019, 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[2]  Prem Prakash Jayaraman,et al.  An Industrial IoT Solution for Evaluating Workers' Performance Via Activity Recognition , 2019, 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS).

[3]  Faicel Chamroukhi,et al.  Physical Human Activity Recognition Using Wearable Sensors , 2015, Sensors.

[4]  Thomas Bauernhansl,et al.  Activity recognition in manual manufacturing: Detecting screwing processes from sensor data , 2019, Procedia CIRP.

[5]  Hirohiko Suwa,et al.  Kinect-Based Micro-Behavior Sensing System for Learning the Smart Assistance with Human Subjects Inside Their Homes , 2018, 2018 Workshop on Metrology for Industry 4.0 and IoT.

[6]  Diane J. Cook,et al.  Activity Learning: Discovering, Recognizing, and Predicting Human Behavior from Sensor Data , 2015 .

[7]  Alex Mihailidis,et al.  A review on video-based active and assisted living technologies for automated lifelogging , 2020, Expert Syst. Appl..

[8]  D. Petri,et al.  Estimating and Controlling the Uncertainty of Learning Machines , 2006, Proceedings of the 2006 IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement (AMUEM 2006).

[9]  Lorenzo Scalise,et al.  Wearables for health and fitness: Measurement characteristics and accuracy , 2018, 2018 IEEE International Instrumentation and Measurement Technology Conference (I2MTC).

[10]  Roozbeh Jafari,et al.  Personalizing Activity Recognition Models Through Quantifying Different Types of Uncertainty Using Wearable Sensors , 2020, IEEE Transactions on Biomedical Engineering.

[11]  Andy Adler,et al.  Validation of the Empatica E4 wristband , 2016, 2016 IEEE EMBS International Student Conference (ISC).

[12]  Nuno M. Garcia,et al.  Approach for the Development of a Framework for the Identification of Activities of Daily Living Using Sensors in Mobile Devices , 2018, Sensors.

[13]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[14]  D. Petri,et al.  Uncertainty analysis of Learning-from-Examples algorithms , 2008, 2008 IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement.

[15]  Chris D. Nugent,et al.  Improving the Collection and Understanding the Quality of Datasets for the Aim of Human Activity Recognition , 2019, Smart Assisted Living.

[16]  Claudio Bettini,et al.  Automatic Detection of Urban Features from Wheelchair Users’ Movements , 2019, 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom.

[17]  Jiong Jin,et al.  A Survey on Anomalous Behavior Detection for Elderly Care Using Dense-Sensing Networks , 2020, IEEE Communications Surveys & Tutorials.

[18]  Lorenzo Scalise,et al.  Accuracy of Heart Rate Measurements by a Smartwatch in Low Intensity Activities , 2019, 2019 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[19]  Lorenzo Scalise,et al.  Wrist-worn and chest-strap wearable devices: Systematic review on accuracy and metrological characteristics , 2020 .

[20]  Josef Hallberg,et al.  Collection of a Diverse, Realistic and Annotated Dataset for Wearable Activity Recognition , 2018, 2018 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops).