Vision-Based Fallen Person Detection for the Elderly

Falls are serious and costly for elderly people. The Centers for Disease Control and Prevention of the US reports that millions of older people, 65 and older, fall each year at least once. Serious injuries such as; hip fractures, broken bones or head injury, are caused by 20% of the falls. The time it takes to respond and treat a fallen person is crucial. With this paper we present a new, non-invasive system for fallen people detection. Our approach uses only stereo camera data for passively sensing the environment. The key novelty is a human fall detector which uses a CNN based human pose estimator in combination with stereo data to reconstruct the human pose in 3D and estimate the ground plane in 3D. Furthermore, our system consists of a reasoning module which formulates a number of measures to reason whether a person is fallen. We have tested our approach in different scenarios covering most activities elderly people might encounter living at home. Based on our extensive evaluations, our systems shows high accuracy and almost no miss-classification. To reproduce our results, the implementation is publicly available to the scientific community.

[1]  C. Becker,et al.  Evaluation of a fall detector based on accelerometers: A pilot study , 2005, Medical and Biological Engineering and Computing.

[2]  Alex Mihailidis,et al.  An intelligent emergency response system: preliminary development and testing of automated fall detection , 2005, Journal of telemedicine and telecare.

[3]  Liang Xu,et al.  Using Wearable Sensor and NMF Algorithm to Realize Ambulatory Fall Detection , 2006, ICNC.

[4]  Allen R. Hanson,et al.  Aging in place: fall detection and localization in a distributed smart camera network , 2007, ACM Multimedia.

[5]  C. Rougier,et al.  Monocular 3D Head Tracking to Detect Falls of Elderly People , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  D. DuBois,et al.  A formula to estimate the approximate surface area if height and weight be known , 1989 .

[7]  E. Finkelstein,et al.  The costs of fatal and non-fatal falls among older adults , 2006, Injury Prevention.

[8]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[10]  V. Vaidehi,et al.  Video based automatic fall detection in indoor environment , 2011, 2011 International Conference on Recent Trends in Information Technology (ICRTIT).

[11]  Georgios Tzimiropoulos,et al.  Human Pose Estimation via Convolutional Part Heatmap Regression , 2016, ECCV.

[12]  Horst-Michael Groß,et al.  Fallen Person Detection for Mobile Robots Using 3D Depth Data , 2013, 2013 IEEE International Conference on Systems, Man, and Cybernetics.

[13]  Vassilis Athitsos,et al.  A survey on vision-based fall detection , 2015, PETRA.

[14]  Alan F. Newell,et al.  Gathering the requirements for a fall monitor using drama and video with older people , 2006 .

[15]  A. Enis Çetin,et al.  HMM Based Falling Person Detection Using Both Audio and Video , 2005, 2006 IEEE 14th Signal Processing and Communications Applications.

[16]  Bart Vanrumste,et al.  How to detect human fall in video? An overview , 2009 .

[17]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[19]  O. Wilder‐Smith,et al.  How dangerous are falls in old people at home? , 1981, British medical journal.

[20]  Chengcui Zhang,et al.  A progressive morphological filter for removing nonground measurements from airborne LIDAR data , 2003, IEEE Trans. Geosci. Remote. Sens..

[21]  Rached Tourki,et al.  Definition and Performance Evaluation of a Robust SVM Based Fall Detection Solution , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[22]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Zhi Zhang,et al.  Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation , 2017, IEEE Transactions on Multimedia.

[24]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[25]  Miao Yu,et al.  A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment , 2012, IEEE Transactions on Information Technology in Biomedicine.

[26]  E. F. Du Bois,et al.  A formula to estimate the approximate surface area if height and weight be known. 1916. , 1989, Nutrition.

[27]  Rita Cucchiara,et al.  A multi‐camera vision system for fall detection and alarm generation , 2007, Expert Syst. J. Knowl. Eng..

[28]  Bernt Schiele,et al.  2D Human Pose Estimation: New Benchmark and State of the Art Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Zaid A. Mundher,et al.  A Real-Time Fall Detection System in Elderly Care Using Mobile Robot and Kinect Sensor , 2014 .

[30]  Nicholas Roy,et al.  Lying Pose Recognition for Elderly Fall Detection , 2012 .

[31]  J. O'Loughlin,et al.  Incidence of and risk factors for falls and injurious falls among the community-dwelling elderly. , 1993, American journal of epidemiology.

[32]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[33]  Alex Mihailidis,et al.  Towards a single sensor passive solution for automated fall detection , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[35]  Xinguo Yu Approaches and principles of fall detection for elderly and patient , 2008, HealthCom 2008 - 10th International Conference on e-health Networking, Applications and Services.

[36]  Peter H. N. de With,et al.  Video-Based Fall Detection in the Home Using Principal Component Analysis , 2008, ACIVS.

[37]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[38]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[39]  Deva Ramanan,et al.  Learning to parse images of articulated bodies , 2006, NIPS.