Lower body motion analysis to detect falls and near falls on stairs

PurposeWe present a methodology to automatically detect falls on stairs, an application of computer vision and machine learning techniques with major real-world importance. Falls on the stairs, in particular, are a common cause of injury among older adults. Comprehending the conditions under which accidents take place could significantly aid in the prevention of falls, support independent living, and improve quality of life.t.MethodsWe extract a set of features, composed of Fourier coefficients and entropy metrics of instantaneous velocities from 3D motion sensor data, to encode lower body motion during stair navigation. A supervised learning algorithm is then trained on manually annotated data simulated in a home laboratory.ResultsIn our empirical analysis, the algorithm obtains high fall detection accuracy (< 92%) and a low false positive rate (5–7%). In contrast with previous research, we identify that motion of the hips, rather than that of the feet, is the best indicator of dangerous activity given the 3D trajectory of various lower body joints. It is also shown that entropy measures alone provide sufficient information to detect abnormal events on stairs.ConclusionsThe study of falls is difficult due to their exceedingly sparse nature; but an automatic non-contact fall detection system can assist in data collection by sieving through large quantities of data, e.g., from public stairways.

[1]  Max Mignotte,et al.  Fall Detection from Depth Map Video Sequences , 2011, ICOST.

[2]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[3]  M. Palaniswami,et al.  Understanding Ageing Effects by Approximate Entropy Analysis of gait variability , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Alex Mihailidis,et al.  Video analysis for identifying human operation difficulties and faucet usability assessment , 2013, Neurocomputing.

[5]  Alex Mihailidis,et al.  Vision-based categorization of upper body motion impairments and post-stroke motion synergies , 2014 .

[6]  N. Stergiou,et al.  A Novel Approach to Measure Variability in the Anterior Cruciate Ligament Deficient Knee During Walking: The Use of the Approximate Entropy in Orthopaedics , 2006, Journal of Clinical Monitoring and Computing.

[7]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[8]  Marjorie Skubic,et al.  Fall Detection in Homes of Older Adults Using the Microsoft Kinect , 2015, IEEE Journal of Biomedical and Health Informatics.

[9]  M. Palaniswami,et al.  Journal of Neuroengineering and Rehabilitation Open Access a Comparative Study on Approximate Entropy Measure and Poincaré Plot Indexes of Minimum Foot Clearance Variability in the Elderly during Walking , 2008 .

[10]  Stephen W Marshall,et al.  Prevalence of selected risk and protective factors for falls in the home. , 2005, American journal of preventive medicine.

[11]  Marjorie Skubic,et al.  Evaluation of an inexpensive depth camera for in-home gait assessment , 2011, J. Ambient Intell. Smart Environ..

[12]  Alex Mihailidis,et al.  Vision-based approach for long-term mobility monitoring: Single case study following total hip replacement. , 2014, Journal of rehabilitation research and development.

[13]  Christian Marzahl,et al.  Unobtrusive Fall Detection Using 3D Images of a Gaming Console: Concept and First Results , 2012 .

[14]  Bogdan Kwolek,et al.  Human Fall Detection Using Kinect Sensor , 2013, CORES.

[15]  Alex Mihailidis,et al.  3D Human Motion Analysis to Detect Abnormal Events on Stairs , 2012, 2012 Second International Conference on 3D Imaging, Modeling, Processing, Visualization & Transmission.

[16]  Marjorie Skubic,et al.  Passive in-home measurement of stride-to-stride gait variability comparing vision and Kinect sensing , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[18]  O. Celik,et al.  Systematic review of Kinect applications in elderly care and stroke rehabilitation , 2014, Journal of NeuroEngineering and Rehabilitation.

[19]  Nadia Magnenat-Thalmann,et al.  Fall Detection Based on Body Part Tracking Using a Depth Camera , 2015, IEEE Journal of Biomedical and Health Informatics.

[20]  A. Mihailidis,et al.  Vision-based posture assessment to detect and categorize compensation during robotic rehabilitation therapy , 2012, 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[21]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[22]  Martin Kampel,et al.  Introducing the use of depth data for fall detection , 2013, Personal and Ubiquitous Computing.

[23]  Claude E. Shannon,et al.  The Mathematical Theory of Communication , 1950 .

[24]  Alex Mihailidis,et al.  A real-world deployment of the COACH prompting system , 2013, J. Ambient Intell. Smart Environ..

[25]  Alex Mihailidis,et al.  Towards a single sensor passive solution for automated fall detection , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Bingbing Ni,et al.  RGBD-HuDaAct: A color-depth video database for human daily activity recognition , 2011, ICCV Workshops.

[27]  David J. Fleet,et al.  Human attributes from 3D pose tracking , 2010, Comput. Vis. Image Underst..

[28]  Jesse Hoey,et al.  Automated Detection of Unusual Events on Stairs , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[29]  Bart Selman,et al.  Human Activity Detection from RGBD Images , 2011, Plan, Activity, and Intent Recognition.

[30]  Toby Sharp,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR.

[31]  Bogdan Kwolek,et al.  Fuzzy Inference-Based Reliable Fall Detection Using Kinect and Accelerometer , 2012, ICAISC.

[32]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Jorge Cancela,et al.  Multi-parametric system for the continuous assessment and monitoring of motor status in Parkinson's disease: An entropy-based gait comparison , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[34]  Jeffrey M. Hausdorff,et al.  Multiscale entropy analysis of human gait dynamics. , 2003, Physica A.