Elderly Fall Detection Systems: A Literature Survey

Falling is among the most damaging event elderly people may experience. With the ever-growing aging population, there is an urgent need for the development of fall detection systems. Thanks to the rapid development of sensor networks and the Internet of Things (IoT), human-computer interaction using sensor fusion has been regarded as an effective method to address the problem of fall detection. In this paper, we provide a literature survey of work conducted on elderly fall detection using sensor networks and IoT. Although there are various existing studies which focus on the fall detection with individual sensors, such as wearable ones and depth cameras, the performance of these systems are still not satisfying as they suffer mostly from high false alarms. Literature shows that fusing the signals of different sensors could result in higher accuracy and lower false alarms, while improving the robustness of such systems. We approach this survey from different perspectives, including data collection, data transmission, sensor fusion, data analysis, security, and privacy. We also review the benchmark data sets available that have been used to quantify the performance of the proposed methods. The survey is meant to provide researchers in the field of elderly fall detection using sensor networks with a summary of progress achieved up to date and to identify areas where further effort would be beneficial.

[1]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[2]  Xugang Xi,et al.  Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Plantar Pressure , 2020, Complex..

[3]  Jui-Chung Hung,et al.  GA-SVM applied to the fall detection system , 2017, 2017 International Conference on Applied System Innovation (ICASI).

[4]  K. Aminian,et al.  Fall detection with body-worn sensors , 2013, Zeitschrift für Gerontologie und Geriatrie.

[5]  Xianzhi Wang,et al.  Collaborative Fall Detection Using Smart Phone and Kinect , 2018, Mob. Networks Appl..

[6]  Bogdan Kwolek,et al.  Fuzzy inference-based fall detection using kinect and body-worn accelerometer , 2016, Appl. Soft Comput..

[7]  Hiram Ponce,et al.  A vision-based approach for fall detection using multiple cameras and convolutional neural networks: A case study using the UP-Fall detection dataset , 2019, Comput. Biol. Medicine.

[8]  Tong Zhang,et al.  Fall Detection by Embedding an Accelerometer in Cellphone and Using KFD Algorithm , 2006 .

[9]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.

[10]  Rossana M. de Castro Andrade,et al.  An Algorithm for Fall Detection using Data from SmartWatch , 2018, 2018 13th Annual Conference on System of Systems Engineering (SoSE).

[11]  Tao Xu,et al.  New Advances and Challenges of Fall Detection Systems: A Survey , 2018 .

[12]  Enrico Baccaglini,et al.  Insights into the role of feedbacks in the tracking loop of a modular fall-detection algorithm , 2014, 2014 IEEE Visual Communications and Image Processing Conference.

[13]  Galidiya Petrova,et al.  Privacy Preserving Fall Detection Based on Simple Human Silhouette Extraction and a Linear Support Vector Machine , 2016 .

[14]  Dirk Pesch,et al.  FallDeFi , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[15]  P. Ray Home Health Hub Internet of Things (H3IoT): An architectural framework for monitoring health of elderly people , 2014, 2014 International Conference on Science Engineering and Management Research (ICSEMR).

[16]  John Cosmas,et al.  A comparison between heuristic and machine learning techniques in fall detection using Kinect v2 , 2016, 2016 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[17]  Abbes Amira,et al.  CS-based fall detection for connected health applications , 2017, 2017 Fourth International Conference on Advances in Biomedical Engineering (ICABME).

[18]  Zhizeng Luo,et al.  Evaluation of Feature Extraction and Recognition for Activity Monitoring and Fall Detection Based on Wearable sEMG Sensors , 2017, Sensors.

[19]  D. Y. C. Lie,et al.  A real-time robust fall detection system using a wireless gait analysis sensor and an Artificial Neural Network , 2014, 2014 IEEE Healthcare Innovation Conference (HIC).

[20]  Xiaochao Dang,et al.  KS-FALL: Indoor Human Fall Detection Method Under 5GHz Wireless Signals , 2019, IOP Conference Series: Materials Science and Engineering.

[21]  Senem Velipasalar,et al.  Wearable Camera- and Accelerometer-Based Fall Detection on Portable Devices , 2016, IEEE Embedded Systems Letters.

[22]  Rached Tourki,et al.  Definition and Performance Evaluation of a Robust SVM Based Fall Detection Solution , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[23]  Shengke Wang,et al.  Learning spatiotemporal representations for human fall detection in surveillance video , 2019, J. Vis. Commun. Image Represent..

[24]  Nasser Kehtarnavaz,et al.  A survey of depth and inertial sensor fusion for human action recognition , 2015, Multimedia Tools and Applications.

[25]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[26]  Donald Y. C. Lie,et al.  A real-time fall detection system using a wearable gait analysis sensor and a Support Vector Machine (SVM) classifier , 2015, 2015 Eighth International Conference on Mobile Computing and Ubiquitous Networking (ICMU).

[27]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[28]  Jesús Francisco Vargas-Bonilla,et al.  Real-Life/Real-Time Elderly Fall Detection with a Triaxial Accelerometer , 2018, Sensors.

[29]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[30]  Y. Nishida,et al.  Sensor network for supporting elderly care home , 2004, Proceedings of IEEE Sensors, 2004..

[31]  Guang-Zhong Yang,et al.  Body sensor networks , 2006 .

[32]  H. Tenhunen,et al.  Edge-AI in LoRa-based Health Monitoring: Fall Detection System with Fog Computing and LSTM Recurrent Neural Networks , 2019, 2019 42nd International Conference on Telecommunications and Signal Processing (TSP).

[33]  Matthias Pätzold,et al.  A Machine Learning Approach for Fall Detection and Daily Living Activity Recognition , 2019, IEEE Access.

[34]  David E. Bloom,et al.  Population Aging: Facts, Challenges, and Responses , 2011 .

[35]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[36]  Stephan Sigg,et al.  5G Ubiquitous Sensing: Passive Environmental Perception in Cellular Systems , 2017, 2017 IEEE 86th Vehicular Technology Conference (VTC-Fall).

[37]  Mehmet C. Vuran,et al.  Semi-supervised near-miss fall detection for ironworkers with a wearable inertial measurement unit , 2016 .

[38]  María de Lourdes Martínez-Villaseñor,et al.  UP-Fall Detection Dataset: A Multimodal Approach , 2019, Sensors.

[39]  David P. Colvin,et al.  Falls In The Elderly: Detection And Assessment , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[40]  Haibo Wang,et al.  Silhouette Orientation Volumes for Efficient Fall Detection in Depth Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[41]  R. J. Gurley,et al.  Persons found in their homes helpless or dead. , 1996, The New England journal of medicine.

[42]  Hao He,et al.  RF-Based Fall Monitoring Using Convolutional Neural Networks , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[43]  G. Williams,et al.  A smart fall and activity monitor for telecare applications , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[44]  Wan-Yu Deng,et al.  Cross-person activity recognition using reduced kernel extreme learning machine , 2014, Neural Networks.

[45]  Irene Y. H. Gu,et al.  Fall detection in RGB-D videos by combining shape and motion features , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Iván García-Magariño,et al.  Combining novelty detectors to improve accelerometer-based fall detection , 2017, Medical & Biological Engineering & Computing.

[47]  Nasser Kehtarnavaz,et al.  UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[48]  Yoong Choon Chang,et al.  A simple vision-based fall detection technique for indoor video surveillance , 2015, Signal Image Video Process..

[49]  B Leff THE PACE PROGRAM , 1997, Journal of the American Geriatrics Society.

[50]  Tanvi Banerjee,et al.  Improvement of acoustic fall detection using Kinect depth sensing , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[51]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[52]  Fatih Erden,et al.  Multi-sensor ambient assisted living system for fall detection , 2014 .

[53]  Fu-Shan Jaw,et al.  Evaluating the specifications of built-in accelerometers in smartphones on fall detection performance , 2018 .

[54]  Abbes Amira,et al.  Fall detection and human activity classification using wearable sensors and compressed sensing , 2019, Journal of Ambient Intelligence and Humanized Computing.

[55]  Tim J. Ellis,et al.  Fall detection without people: A simulation approach tackling video data scarcity , 2018, Expert Syst. Appl..

[56]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[57]  Liang Liu,et al.  An automatic fall detection framework using data fusion of Doppler radar and motion sensor network , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[58]  Zhu Wang,et al.  Special issue on device-free sensing for human behavior recognition , 2019, Personal and Ubiquitous Computing.

[59]  Lei Zhang,et al.  WiDIGR: Direction-Independent Gait Recognition System Using Commercial Wi-Fi Devices , 2020, IEEE Internet of Things Journal.

[60]  Haibo Wang,et al.  Shape feature encoding via Fisher Vector for efficient fall detection in depth-videos , 2015, Appl. Soft Comput..

[61]  Imen Charfi,et al.  Fast prototyping of a SoC-based smart-camera: a real-time fall detection case study , 2016, Journal of Real-Time Image Processing.

[62]  Alex Pentland,et al.  MIThril 2003: applications and architecture , 2003, Seventh IEEE International Symposium on Wearable Computers, 2003. Proceedings..

[63]  Ahmad Diab,et al.  Elder Tracking and Fall Detection System Using Smart Tiles , 2017, IEEE Sensors Journal.

[64]  Qing Han,et al.  A Two-Stream Approach to Fall Detection With MobileVGG , 2020, IEEE Access.

[65]  Rita Paradiso,et al.  A wearable health care system based on knitted integrated sensors , 2005, IEEE Transactions on Information Technology in Biomedicine.

[66]  Shir-Kuan Lin,et al.  Fall detection for multiple pedestrians using depth image processing technique , 2014, Comput. Methods Programs Biomed..

[67]  Paola Pierleoni,et al.  A High Reliability Wearable Device for Elderly Fall Detection , 2015, IEEE Sensors Journal.

[68]  Greg Mori,et al.  A comparison of accuracy of fall detection algorithms (threshold-based vs. machine learning) using waist-mounted tri-axial accelerometer signals from a comprehensive set of falls and non-fall trials , 2016, Medical & Biological Engineering & Computing.

[69]  Vassilis Athitsos,et al.  A survey on vision-based fall detection , 2015, PETRA.

[70]  Kyung-Sup Kwak,et al.  The Internet of Things for Health Care: A Comprehensive Survey , 2015, IEEE Access.

[71]  M. Shamim Hossain,et al.  A Survey on Sensor-Cloud: Architecture, Applications, and Approaches , 2013, Int. J. Distributed Sens. Networks.

[72]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[73]  Víctor M. González Suárez,et al.  Improving Fall Detection Using an On-Wrist Wearable Accelerometer , 2018, Sensors.

[74]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[75]  Xiang Li,et al.  Boosting fine-grained activity sensing by embracing wireless multipath effects , 2018, CoNEXT.

[76]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[77]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[78]  Majd Saleh,et al.  Elderly Fall Detection Using Wearable Sensors: A Low Cost Highly Accurate Algorithm , 2019, IEEE Sensors Journal.

[79]  Hannu Tenhunen,et al.  Energy efficient wearable sensor node for IoT-based fall detection systems , 2018, Microprocess. Microsystems.

[80]  Dimitrios Makris,et al.  Customisable fall detection: a hybrid approach using physics based simulation and machine learning , 2016 .

[81]  J. Habetha The myheart project - Fighting cardiovascular diseases by prevention and early diagnosis , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[82]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[83]  Myeongseob Ko,et al.  A Novel Approach for Outdoor Fall Detection Using Multidimensional Features from A Single Camera , 2018 .

[84]  M. Skubic,et al.  Senior residents’ perceived need of and preferences for “smart home” sensor technologies , 2008, International Journal of Technology Assessment in Health Care.

[85]  Jos M G A Schols,et al.  Usability of a wearable fall detection prototype from the perspective of older people–A real field testing approach , 2018, Journal of clinical nursing.

[86]  James J. Little,et al.  Video-based Human Fall Detection in Smart Homes Using Deep Learning , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[87]  Pramod K. Varshney,et al.  Autonomous Fall Detection With Wearable Cameras by Using Relative Entropy Distance Measure , 2017, IEEE Transactions on Human-Machine Systems.

[88]  Javaan Chahl,et al.  Accurate Fall Detection and Localization for Elderly People Based on Neural Network and Energy-Efficient Wireless Sensor Network , 2018, Energies.

[89]  Ling Shao,et al.  RGB-D datasets using microsoft kinect or similar sensors: a survey , 2017, Multimedia Tools and Applications.

[90]  Atsushi Shimada,et al.  Fall detection using optical level anonymous image sensing system , 2019, Optics & Laser Technology.

[91]  Yoji Yamada,et al.  Fall Risk Reduction for the Elderly by Using Mobile Robots Based on Deep Reinforcement Learning , 2018, J. Robotics Netw. Artif. Life.

[92]  Vassilis Athitsos,et al.  Evaluating Depth-Based Computer Vision Methods for Fall Detection under Occlusions , 2014, ISVC.

[93]  V. C. Padaki,et al.  Smart Vest: wearable multi-parameter remote physiological monitoring system. , 2008, Medical engineering & physics.

[94]  Farhanahani Mahmud,et al.  Evaluation of Three-Axial Wireless-based Accelerometer for Fall Detection Analysis , 2015 .

[95]  Nadia Magnenat-Thalmann,et al.  Fall Detection Based on Body Part Tracking Using a Depth Camera , 2015, IEEE Journal of Biomedical and Health Informatics.

[96]  Yoji Yamada,et al.  Risks of Deep Reinforcement Learning Applied to Fall Prevention Assist by Autonomous Mobile Robots in the Hospital , 2018, Big Data Cogn. Comput..

[97]  G. Demiris,et al.  Fall Detection Devices and Their Use With Older Adults: A Systematic Review , 2014, Journal of geriatric physical therapy.

[98]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.

[99]  Pietro Siciliano,et al.  An active vision system for fall detection and posture recognition in elderly healthcare , 2010, 2010 Design, Automation & Test in Europe Conference & Exhibition (DATE 2010).

[100]  N. Kumar,et al.  Novel fall detection algorithm for the elderly people , 2014, 2014 International Conference on Science Engineering and Management Research (ICSEMR).

[101]  Falin Wu,et al.  Development of a Wearable-Sensor-Based Fall Detection System , 2015, International journal of telemedicine and applications.

[102]  Hongjie Chen,et al.  G-Fall: Device-free and Training-free Fall Detection with Geophones , 2019, 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[103]  Athanassios Skodras,et al.  On the Comparison of Wearable Sensor Data Fusion to a Single Sensor Machine Learning Technique in Fall Detection , 2018, Sensors.

[104]  Frank Vahid,et al.  Privacy perception and fall detection accuracy for in-home video assistive monitoring with privacy enhancements , 2012, SIGHIT Rec..

[105]  Zhihua Xia,et al.  Fall Detection Algorithm Based on Triaxial Accelerometer and Magnetometer , 2016 .

[106]  Bogdan Kwolek,et al.  Fall detection using ceiling-mounted 3D depth camera , 2015, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[107]  Seiichi Serikawa,et al.  Automatic Fall Detection System of Unsupervised Elderly People Using Smartphone , 2017 .

[108]  Antonio Torralba,et al.  Through-Wall Human Pose Estimation Using Radio Signals , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[109]  Ruzena Bajcsy,et al.  Berkeley MHAD: A comprehensive Multimodal Human Action Database , 2013, 2013 IEEE Workshop on Applications of Computer Vision (WACV).

[110]  Tong Wu,et al.  A Mobile Cloud Collaboration Fall Detection System Based on Ensemble Learning , 2020, ASSETS.

[111]  Tai-Wen Yue,et al.  A wrist -worn fall detection system using accelerometers and gyroscopes , 2014, Proceedings of the 11th IEEE International Conference on Networking, Sensing and Control.

[112]  Damien Brulin,et al.  Design of a Smart Sole with Advanced Fall Detection Algorithm , 2019, Journal of Sensor Technology.

[113]  Stefan Madansingh,et al.  Smartphone based fall detection system , 2015, 2015 15th International Conference on Control, Automation and Systems (ICCAS).

[114]  Irene Y. H. Gu,et al.  Fall detection in RGB-D videos for elderly care , 2015, 2015 17th International Conference on E-health Networking, Application & Services (HealthCom).

[115]  James Brusey,et al.  An Event-Triggered Machine Learning Approach for Accelerometer-Based Fall Detection , 2017, Sensors.

[116]  Maarit Kangas,et al.  Comparison of low-complexity fall detection algorithms for body attached accelerometers. , 2008, Gait & posture.

[117]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[118]  Rui Liu,et al.  Fall detection for elderly person care in a vision-based home surveillance environment using a monocular camera , 2014, Signal Image Video Process..

[119]  Ennio Gambi,et al.  Proposal and Experimental Evaluation of Fall Detection Solution Based on Wearable and Depth Data Fusion , 2015, ICT Innovations.

[120]  Klaus Hauer,et al.  The FARSEEING real-world fall repository: a large-scale collaborative database to collect and share sensor signals from real-world falls , 2016, European Review of Aging and Physical Activity.

[121]  Dong Xuan,et al.  PerFallD: A pervasive fall detection system using mobile phones , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[122]  André Eugenio Lazzaretti,et al.  A Movement Decomposition and Machine Learning-Based Fall Detection System Using Wrist Wearable Device , 2018, IEEE Sensors Journal.

[123]  Abdelhamid Bouchachia,et al.  Activity recognition for indoor fall detection using convolutional neural network , 2017, 2017 Fifteenth IAPR International Conference on Machine Vision Applications (MVA).

[124]  Matt Welsh,et al.  Sensor networks for emergency response: challenges and opportunities , 2004, IEEE Pervasive Computing.

[125]  Frédérique C. Pivot,et al.  Fall Detection and Prevention for the Elderly: A Review of Trends and Challenges , 2013 .

[126]  A. Sabatini,et al.  Prior-to- and Post-Impact Fall Detection Using Inertial and Barometric Altimeter Measurements , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[127]  Weidong Min,et al.  Support vector machine approach to fall recognition based on simplified expression of human skeleton action and fast detection of start key frame using torso angle , 2018, IET Comput. Vis..

[128]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[129]  Fu-Shan Jaw,et al.  Enhanced characterization of an accelerometer-based fall detection algorithm using a repository , 2017 .