Deep-Learning-Based Signal Enhancement of Low-Resolution Accelerometer for Fall Detection Systems

In the last two decades, fall detection (FD) systems have been developed as a popular assistive technology. Such systems automatically detect critical fall events and immediately alert medical professionals or caregivers. To support long-term FD services, various power-saving strategies have been implemented. Among them, a reduced sampling rate is a common approach for an energy-efficient system in the real-world. However, the performance of FD systems is diminished owing to low-resolution (LR) accelerometer signals. To improve the detection accuracy with LR accelerometer signals, several technical challenges must be considered, including misalignment, mismatch of effective features, and the degradation effects. In this work, a deep-learning-based accelerometer signal enhancement (ASE) model is proposed to improve the detection performance of LR-FD systems. This proposed model reconstructs high-resolution (HR) signals from the LR signals by learning the relationship between the LR and HR signals. The results show that the FD system using support vector machine and the proposed ASE model at an extremely low sampling rate (sampling rate < 2 Hz) achieved 97.34% and 90.52% accuracies in the SisFall and FallAllD datasets, respectively, while those without ASE models only achieved 95.92% and 87.47% accuracies in the SisFall and FallAllD datasets, respectively. This study demonstrates that the ASE model helps the FD systems tackle the technical challenges of LR signals and achieve better detection performance.

[1]  Reza Malekian,et al.  Fall detection monitoring systems: a comprehensive review , 2018, J. Ambient Intell. Humaniz. Comput..

[2]  B. Isaacs,et al.  How dangerous are falls in old people at home? , 1981, British medical journal.

[3]  MengChu Zhou,et al.  An online fault detection model and strategies based on SVM-grid in clouds , 2018, IEEE/CAA Journal of Automatica Sinica.

[4]  Xinyu Li,et al.  Speech Audio Super-Resolution for Speech Recognition , 2019, INTERSPEECH.

[5]  Nigel H. Lovell,et al.  Low-Power Fall Detector Using Triaxial Accelerometry and Barometric Pressure Sensing , 2016, IEEE Transactions on Industrial Informatics.

[6]  Klaus Hauer,et al.  The FARSEEING real-world fall repository: a large-scale collaborative database to collect and share sensor signals from real-world falls , 2016, European Review of Aging and Physical Activity.

[7]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[8]  Kai-Chun Liu,et al.  Transition-Aware Housekeeping Task Monitoring Using Single Wrist-Worn Sensor , 2018, IEEE Sensors Journal.

[9]  Lorenzo Chiari,et al.  Validation of accuracy of SVM-based fall detection system using real-world fall and non-fall datasets , 2017, PloS one.

[10]  Francesco Piazza,et al.  Unsupervised electric motor fault detection by using deep autoencoders , 2019, IEEE/CAA Journal of Automatica Sinica.

[11]  Giancarlo Fortino,et al.  A Smartphone-Enabled Fall Detection Framework for Elderly People in Connected Home Healthcare , 2019, IEEE Network.

[12]  M. Saleh,et al.  FallAllD: An Open Dataset of Human Falls and Activities of Daily Living for Classical and Deep Learning Applications , 2021, IEEE Sensors Journal.

[13]  Nigel H. Lovell,et al.  Selecting Power-Efficient Signal Features for a Low-Power Fall Detector , 2017, IEEE Transactions on Biomedical Engineering.

[14]  O. Wilder‐Smith,et al.  How dangerous are falls in old people at home? , 1981, British medical journal.

[15]  Yu Tsao,et al.  End-to-End Waveform Utterance Enhancement for Direct Evaluation Metrics Optimization by Fully Convolutional Neural Networks , 2017, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[16]  Kai-Chun Liu,et al.  Drinking Event Detection and Episode Identification Using 3D-Printed Smart Cup , 2020, IEEE Sensors Journal.

[17]  Q. M. Jonathan Wu,et al.  Low-resolution face recognition: a review , 2013, The Visual Computer.

[18]  Robert J. Piechocki,et al.  Extending the battery lifetime of wearable sensors with embedded machine learning , 2018, 2018 IEEE 4th World Forum on Internet of Things (WF-IoT).

[19]  Jaime S. Cardoso,et al.  Automated Development of Custom Fall Detectors: Position, Model and Rate Impact in Performance , 2020, IEEE Sensors Journal.

[20]  María de Lourdes Martínez-Villaseñor,et al.  UP-Fall Detection Dataset: A Multimodal Approach , 2019, Sensors.

[21]  Jung-Yoon Kim,et al.  Analysis of energy consumption for wearable ECG devices , 2014, IEEE SENSORS 2014 Proceedings.

[22]  Kai-Chun Liu,et al.  Impact of Sampling Rate on Wearable-Based Fall Detection Systems Based on Machine Learning Models , 2018, IEEE Sensors Journal.

[23]  Lei Yang,et al.  3D depth image analysis for indoor fall detection of elderly people , 2016, Digit. Commun. Networks.

[24]  Farid García,et al.  A comprehensive survey on support vector machine classification: Applications, challenges and trends , 2020, Neurocomputing.

[25]  Eduardo Casilari-Pérez,et al.  UMAFall: A Multisensor Dataset for the Research on Automatic Fall Detection , 2017, FNC/MobiSPC.

[26]  Jean-Yves Fourniols,et al.  Smart wearable systems: Current status and future challenges , 2012, Artif. Intell. Medicine.

[27]  Mirto Musci,et al.  Embedded Real-Time Fall Detection with Deep Learning on Wearable Devices , 2018, 2018 21st Euromicro Conference on Digital System Design (DSD).

[28]  Parthasarathy Ranganathan,et al.  Investigating the Relationship Between Battery Life and User Acceptance of Dynamic, Energy-Aware Interfaces on Handhelds , 2004, Mobile HCI.

[29]  Francine Gemperle,et al.  Effects of functionality on perceived comfort of wearables , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[30]  Keith Hill,et al.  A snapshot of the prevalence of physical activity amongst older, community dwelling people in Victoria, Australia: patterns across the 'young-old' and 'old-old' , 2007, BMC geriatrics.

[31]  Arun Kumar Sangaiah,et al.  A real-time and ubiquitous network attack detection based on deep belief network and support vector machine , 2020, IEEE/CAA Journal of Automatica Sinica.

[32]  Filip De Turck,et al.  Towards a social and context-aware multi-sensor fall detection and risk assessment platform , 2015, Comput. Biol. Medicine.

[33]  Jesús Francisco Vargas-Bonilla,et al.  SisFall: A Fall and Movement Dataset , 2017, Sensors.

[34]  Manuel Esteve,et al.  Fall detection system for elderly people using IoT and ensemble machine learning algorithm , 2019, Personal and Ubiquitous Computing.

[35]  Billur Barshan,et al.  Detecting Falls with Wearable Sensors Using Machine Learning Techniques , 2014, Sensors.

[36]  A. Mcgregor,et al.  Body-Worn Sensor Design: What Do Patients and Clinicians Want? , 2011, Annals of Biomedical Engineering.

[37]  Jean-Gabriel Minonzio,et al.  eHomeSeniors Dataset: An Infrared Thermal Sensor Dataset for Automatic Fall Detection Research , 2019, Sensors.

[38]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[39]  Ahmet Turan Özdemir,et al.  An Analysis on Sensor Locations of the Human Body for Wearable Fall Detection Devices: Principles and Practice , 2016, Sensors.

[40]  Jeffrey M. Hausdorff,et al.  Evaluation of Accelerometer-Based Fall Detection Algorithms on Real-World Falls , 2012, PloS one.

[41]  Kai-Chun Liu,et al.  An Analysis of Segmentation Approaches and Window Sizes in Wearable-Based Critical Fall Detection Systems With Machine Learning Models , 2020, IEEE Sensors Journal.

[42]  Yu Tsao,et al.  Speech enhancement based on deep denoising autoencoder , 2013, INTERSPEECH.

[43]  Majd Saleh,et al.  Elderly Fall Detection Using Wearable Sensors: A Low Cost Highly Accurate Algorithm , 2019, IEEE Sensors Journal.

[44]  Surapa Thiemjarus,et al.  Automatic Fall Monitoring: A Review , 2014, Sensors.

[45]  Nigel H. Lovell,et al.  A Low-Power Fall Detector Balancing Sensitivity and False Alarm Rate , 2018, IEEE Journal of Biomedical and Health Informatics.

[46]  Shih-Hau Fang,et al.  Developing a mobile phone-based fall detection system on Android platform , 2012, 2012 Computing, Communications and Applications Conference.

[47]  Ying Sun,et al.  An Integrated Vision-Based Approach for Efficient Human Fall Detection in a Home Environment , 2019, IEEE Access.

[48]  Xuemei Guo,et al.  Floor Pressure Imaging for Fall Detection with Fiber-Optic Sensors , 2016, IEEE Pervasive Computing.

[49]  Zihao Zhang,et al.  A Low Power Fall Sensing Technology Based on FD-CNN , 2019, IEEE Sensors Journal.

[50]  Kai-Chun Liu,et al.  Novel Hierarchical Fall Detection Algorithm Using a Multiphase Fall Model , 2017, Sensors.

[51]  Huiru Zheng,et al.  A Novel Energy-Efficient Approach for Human Activity Recognition , 2017, Sensors.

[52]  M. Tinetti,et al.  Predictors and prognosis of inability to get up after falls among elderly persons. , 1993, JAMA.