Fall detection without people: A simulation approach tackling video data scarcity

Abstract We propose an intelligent system to detect human fall events using a physics-based myoskeletal simulation, detecting falls by comparing the simulation with a fall velocity profile using the Hausdorff distance. Previous methods of fall detection are trained using recordings of acted falls which are limited in number, body variability and type of fall and can be unrepresentative of real falls. The paper demonstrates that the use of fall recordings are unnecessary for modelling the fall as the simulation engine can produce a variety of fall events customised to an individual’s physical characteristics using myoskeletal models of different morphology, without pre-knowledge of the falling behaviour. To validate this methodological approach, the simulation is customised by the person’s height, modelling a rigid fall type. This approach allows the detection to be tailored to cohorts in the population (such as the elderly or the infirm) that are not represented in existing fall datasets. The method has been evaluated on several publicly available datasets which show that our method outperforms the results of previously reported research in fall detection. Finally, our approach is demonstrated to be robust to occlusions that hide up to 50% of a fall, which increases the applicability of automatic fall detection in a real-world environment such as the home.

[1]  Peter H. N. de With,et al.  Video-Based Fall Detection in the Home Using Principal Component Analysis , 2008, ACIVS.

[2]  M. Alwan,et al.  A Smart and Passive Floor-Vibration Based Fall Detector for Elderly , 2006, 2006 2nd International Conference on Information & Communication Technologies.

[3]  Tido Röder,et al.  Documentation Mocap Database HDM05 , 2007 .

[4]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[5]  Rustam Stolkin,et al.  Physical simulation for monocular 3D model based tracking , 2011, 2011 IEEE International Conference on Robotics and Automation.

[6]  W. Cleveland LOWESS: A Program for Smoothing Scatterplots by Robust Locally Weighted Regression , 1981 .

[7]  Velislava Spasova,et al.  A survey on automatic fall detection in the context of ambient assisted living systems , 2014 .

[8]  David J. Fleet,et al.  Physics-Based Person Tracking Using the Anthropomorphic Walker , 2010, International Journal of Computer Vision.

[9]  Nadia Baha,et al.  Depth camera based fall detection using human shape and movement , 2016, 2016 IEEE International Conference on Signal and Image Processing (ICSIP).

[10]  Shehroz S. Khan,et al.  Review of Fall Detection Techniques: A Data Availability Perspective , 2016, Medical engineering & physics.

[11]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.

[12]  Vassilis Athitsos,et al.  A survey on vision-based fall detection , 2015, PETRA.

[13]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Jessica K. Hodgins,et al.  Video-based 3D motion capture through biped control , 2012, ACM Trans. Graph..

[15]  Ennio Gambi,et al.  Proposal and Experimental Evaluation of Fall Detection Solution Based on Wearable and Depth Data Fusion , 2015, ICT Innovations.

[16]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[17]  Edouard Auvinet,et al.  Head detection using Kinect camera and its application to fall detection , 2012, 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA).

[18]  Weisong Shi,et al.  Chameleon: personalised and adaptive fall detection of elderly people in home-based environments , 2016, Int. J. Sens. Networks.

[19]  G. Bergen,et al.  Falls and Fall Injuries Among Adults Aged ≥65 Years - United States, 2014. , 2016, MMWR. Morbidity and mortality weekly report.

[20]  Antonio Marín-Hernández,et al.  Feature selection to detect fallen pose using depth images , 2016, 2016 International Conference on Electronics, Communications and Computers (CONIELECOMP).

[21]  Ioannis A. Kakadiaris,et al.  Model-Based Estimation of 3D Human Motion , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Tanvi Banerjee,et al.  Improvement of acoustic fall detection using Kinect depth sensing , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  James M. Keller,et al.  Linguistic summarization of video for fall detection using voxel person and fuzzy logic , 2009, Comput. Vis. Image Underst..

[24]  Global brain atrophy is associated with physical performance and the risk of falls in older adults with cognitive impairment , 2013, Geriatrics & gerontology international.

[25]  Dimitrios Makris,et al.  Customisable fall detection: a hybrid approach using physics based simulation and machine learning , 2016 .

[26]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.

[27]  Rita Cucchiara,et al.  A multi‐camera vision system for fall detection and alarm generation , 2007, Expert Syst. J. Knowl. Eng..

[28]  Surapa Thiemjarus,et al.  Automatic Fall Monitoring: A Review , 2014, Sensors.

[29]  Matti Linnavuo,et al.  Detection of falls among the elderly by a floor sensor using the electric near field , 2010, IEEE Transactions on Information Technology in Biomedicine.

[30]  Stephen J. McKenna,et al.  Activity summarisation and fall detection in a supportive home environment , 2004, ICPR 2004.

[31]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[32]  Antonio M. López,et al.  The SYNTHIA Dataset: A Large Collection of Synthetic Images for Semantic Segmentation of Urban Scenes , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[35]  Pekka Kannus,et al.  Fall-induced deaths among elderly people. , 2005, American journal of public health.

[36]  Matthias Gietzelt,et al.  Acceptance of seniors towards automatic in home fall detection devices , 2016 .

[37]  Jeffrey M. Hausdorff,et al.  Risk factors for falls among older adults: a review of the literature. , 2013, Maturitas.

[38]  Haibo Wang,et al.  Silhouette Orientation Volumes for Efficient Fall Detection in Depth Videos , 2017, IEEE Journal of Biomedical and Health Informatics.

[39]  Thi-Lan Le,et al.  Continuous detection of human fall using multimodal features from Kinect sensors in scalable environment , 2017, Comput. Methods Programs Biomed..

[40]  G. Demiris,et al.  Fall Detection Devices and Their Use With Older Adults: A Systematic Review , 2014, Journal of geriatric physical therapy.

[41]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[42]  C. Becker,et al.  Cost of falls in old age: a systematic review , 2010, Osteoporosis International.

[43]  Scott L. Delp,et al.  Full-Body Musculoskeletal Model for Muscle-Driven Simulation of Human Gait , 2016, IEEE Transactions on Biomedical Engineering.

[44]  Qi Tian,et al.  Human Daily Action Analysis with Multi-view and Color-Depth Data , 2012, ECCV Workshops.

[45]  Hassan Foroosh,et al.  Euclidean path modeling for video surveillance , 2008, Image Vis. Comput..

[46]  Oriol Pujol,et al.  Synthetic Data Generation for Deep Learning in Counting Pedestrians , 2017, ICPRAM.

[47]  Yujiang Xiang,et al.  Physics-based modeling and simulation of human walking: a review of optimization-based and other approaches , 2010 .

[48]  Huan-Wen Tzeng,et al.  Design of fall detection system with floor pressure and infrared image , 2010, 2010 International Conference on System Science and Engineering.

[49]  Chittaranjan A. Mandal,et al.  Automatic Detection of Human Fall in Video , 2007, PReMI.

[50]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[51]  Ping-Min Lin,et al.  A fall detection system using k-nearest neighbor classifier , 2010, Expert Syst. Appl..

[52]  Nadia Magnenat-Thalmann,et al.  Fall detection based on skeleton extraction , 2012, VRCAI '12.

[53]  Monique Thonnat,et al.  Multi-sensors Analysis for Everyday Activity Monitoring , 2007 .

[54]  Vassilis Athitsos,et al.  Evaluating Depth-Based Computer Vision Methods for Fall Detection under Occlusions , 2014, ISVC.

[55]  Huosheng Hu,et al.  New Fast Fall Detection Method Based on Spatio-Temporal Context Tracking of Head by Using Depth Images , 2015, Sensors.

[56]  Vangelis Metsis,et al.  A viewpoint-independent statistical method for fall detection , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[57]  Marjorie Skubic,et al.  An acoustic fall detector system that uses sound height information to reduce the false alarm rate , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[58]  Irene Y. H. Gu,et al.  Human fall detection in videos via boosting and fusing statistical features of appearance, shape and motion dynamics on Riemannian manifolds with applications to assisted living , 2016, Comput. Vis. Image Underst..

[59]  Amy Loutfi,et al.  Challenges and Issues in Multisensor Fusion Approach for Fall Detection: Review Paper , 2016, J. Sensors.

[60]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[61]  S. Robinovitch,et al.  Video capture of the circumstances of falls in elderly people residing in long-term care: an observational study , 2013, The Lancet.

[62]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.