Using Deep Neural Networks for Human Fall Detection Based on Pose Estimation

Requests for caring for and monitoring the health and safety of older adults are increasing nowadays and form a topic of great social interest. One of the issues that lead to serious concerns is human falls, especially among aged people. Computer vision techniques can be used to identify fall events, and Deep Learning methods can detect them with optimum accuracy. Such imaging-based solutions are a good alternative to body-worn solutions. This article proposes a novel human fall detection solution based on the Fast Pose Estimation method. The solution uses Time-Distributed Convolutional Long Short-Term Memory (TD-CNN-LSTM) and 1Dimentional Convolutional Neural Network (1D-CNN) models, to classify the data extracted from image frames, and achieved high accuracies: 98 and 97% for the 1D-CNN and TD-CNN-LSTM models, respectively. Therefore, by applying the Fast Pose Estimation method, which has not been used before for this purpose, the proposed solution is an effective contribution to accurate human fall detection, which can be deployed in edge devices due to its low computational and memory demands.

[1]  Jing-Ming Guo,et al.  FastNet: Fast high-resolution network for human pose estimation , 2022, Image Vis. Comput..

[2]  Le Yu,et al.  Growing status observation for oil palm trees using Unmanned Aerial Vehicle (UAV) images , 2021 .

[3]  Yung-Fa Huang,et al.  A Framework for Fall Detection Based on OpenPose Skeleton and LSTM/GRU Models , 2020, Applied Sciences.

[4]  Joshua Ellul,et al.  Elderly Fall Detection Systems: A Literature Survey , 2020, Frontiers in Robotics and AI.

[5]  Kripesh Adhikari,et al.  Computer vision based posture estimation and fall detection , 2020 .

[6]  Md Mahedi Hasan,et al.  Robust Pose-Based Human Fall Detection Using Recurrent Neural Network , 2019, 2019 IEEE International Conference on Robotics, Automation, Artificial-intelligence and Internet-of-Things (RAAICON).

[7]  Shuyuan Yang,et al.  A Survey of Deep Learning-Based Object Detection , 2019, IEEE Access.

[8]  Sungjoo Kang,et al.  Human-skeleton based Fall-Detection Method using LSTM for Manufacturing Industries , 2019, 2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC).

[9]  Elisson Rocha,et al.  Accelerometer-Based Human Fall Detection Using Convolutional Neural Networks , 2019, Sensors.

[10]  Mao Ye,et al.  Fast Human Pose Estimation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Yoosuf Nizam,et al.  Development of a User-Adaptable Human Fall Detection Based on Fall Risk Levels Using Depth Sensor , 2018, Sensors.

[12]  Yichen Wei,et al.  Simple Baselines for Human Pose Estimation and Tracking , 2018, ECCV.

[13]  Weidong Min,et al.  Detection of Human Falls on Furniture Using Scene Analysis Based on Deep Learning and Activity Characteristics , 2018, IEEE Access.

[14]  Ignacio Arganda-Carreras,et al.  Vision-Based Fall Detection with Convolutional Neural Networks , 2017, Wirel. Commun. Mob. Comput..

[15]  Nabil Zerrouki,et al.  Vision-based fall detection system for improving safety of elderly people , 2017, IEEE Instrumentation & Measurement Magazine.

[16]  John K. Tsotsos,et al.  Vision-Based Fallen Person Detection for the Elderly , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[17]  Yaser Sheikh,et al.  Realtime Multi-person 2D Pose Estimation Using Part Affinity Fields , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[19]  Varun Ramakrishna,et al.  Pose Machines: Articulated Pose Estimation via Inference Machines , 2014, ECCV.

[20]  L. L. Lin,et al.  Peg-in-Hole assembly under uncertain pose estimation , 2014, Proceeding of the 11th World Congress on Intelligent Control and Automation.

[21]  Peter V. Gehler,et al.  Strong Appearance and Expressive Spatial Models for Human Pose Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[22]  Jitendra Malik,et al.  Articulated Pose Estimation Using Discriminative Armlet Classifiers , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Bernt Schiele,et al.  Monocular 3D pose estimation and tracking by detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Alex Mihailidis,et al.  An intelligent emergency response system: preliminary development and testing of automated fall detection , 2005, Journal of telemedicine and telecare.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Maitreyee Dutta,et al.  Performance Evaluation of Different Classification Factors for Early Diagnosis of Alzheimer’s Disease , 2020 .

[27]  Kishanprasad G. Gunale,et al.  INDOOR HUMAN FALL DETECTION SYSTEM BASED ON AUTOMATIC VISION USING COMPUTER VISION AND MACHINE LEARNING ALGORITHMS , 2018 .

[28]  Miao Yu,et al.  Posture Recognition Based Fall Detection System , 2013 .