An Integrated Approach to Fall Detection and Fall Risk Estimation Based on RGB-Depth and Inertial Sensors

Population ageing is a growing phenomenon, especially in Europe, so researchers are developing Active and Assisted Living solutions to promote ageing in place of elderly people. One of the most critical issues is represented by falls, and the development of fall risk estimation and fall detection tools can increase safety of elderly. The aim of this work is to develop fall risk estimation and fall detection tools using data extracted from wearable and vision-based sensors. First, the synchronization issue between heterogeneous data captured by different sensors is addressed, and a straightforward synchronization procedure based on time delays affecting the samples is provided. Then, fall detection algorithms and a fall risk estimation tool based on Timed Up and Go (TUG) test, exploiting wearable Inertial Measurement Units (IMUs) and an RGB-Depth sensor (Microsoft Kinect) are proposed. The fall detection tool is evaluated on 11 healthy adults simulating 4 different falls and performing 4 activities of daily living, while the TUG is tested on 20 healthy subjects. Encouraging preliminary results are obtained with data acquired in laboratory environment. The tools are privacy preserving since only depth and skeleton information captured by Kinect are processed.

[1]  Ennio Gambi,et al.  Proposal and Experimental Evaluation of Fall Detection Solution Based on Wearable and Depth Data Fusion , 2015, ICT Innovations.

[2]  Gina Sprint,et al.  Toward Automating Clinical Assessments: A Survey of the Timed Up and Go , 2015, IEEE Reviews in Biomedical Engineering.

[3]  Barry R. Greene,et al.  Quantitative Falls Risk Assessment Using the Timed Up and Go Test , 2010, IEEE Transactions on Biomedical Engineering.

[4]  P. Olivier,et al.  Accuracy of the Microsoft Kinect sensor for measuring movement in people with Parkinson's disease. , 2014, Gait & posture.

[5]  Jordi Nin,et al.  Citizen in Sensor Networks , 2014, Lecture Notes in Computer Science.

[6]  Maarit Kangas,et al.  Comparison of low-complexity fall detection algorithms for body attached accelerometers. , 2008, Gait & posture.

[7]  Michael Firman,et al.  RGBD Datasets: Past, Present and Future , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[9]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[10]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[11]  References , 1971 .

[12]  Ragnar M Joakimsen,et al.  The association between timed up and go test and history of falls: The Tromsø study , 2007, BMC geriatrics.

[13]  Martin Kampel,et al.  Introducing the use of depth data for fall detection , 2013, Personal and Ubiquitous Computing.

[14]  M. Kangas,et al.  Sensitivity and specificity of fall detection in people aged 40 years and over. , 2009, Gait & Posture.

[15]  Ennio Gambi,et al.  Time synchronization and data fusion for RGB-Depth cameras and inertial sensors in AAL applications , 2015, 2015 IEEE International Conference on Communication Workshop (ICCW).

[16]  Thomas Lindh,et al.  Local Time Synchronization in Bluetooth Piconets for Data Fusion Using Mobile Phones , 2011, 2011 International Conference on Body Sensor Networks.

[17]  F. Horak,et al.  iTUG, a Sensitive and Reliable Measure of Mobility , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Reiner Wichert,et al.  Ambient Assisted Living : 5. AAL-Kongress 2012 , 2012 .

[19]  Christian Marzahl,et al.  Unobtrusive Fall Detection Using 3D Images of a Gaming Console: Concept and First Results , 2012 .

[20]  S. Cerutti,et al.  Barometric Pressure and Triaxial Accelerometry-Based Falls Event Detection , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Ennio Gambi,et al.  Depth Cameras in AAL Environments: Technology and Real-World Applications , 2015 .

[22]  Nasser Kehtarnavaz,et al.  Improving Human Action Recognition Using Fusion of Depth Camera and Inertial Sensors , 2015, IEEE Transactions on Human-Machine Systems.

[23]  Ennio Gambi,et al.  Kinect as a Tool for Gait Analysis: Validation of a Real-Time Joint Extraction Algorithm Working in Side View , 2015, Sensors.

[24]  Sergio Escalera,et al.  Actions in Context: System for People with Dementia , 2013, CitiSens.

[25]  James M. Keller,et al.  Quantitative analysis of 180 degree turns for fall risk assessment using video sensors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Surapa Thiemjarus,et al.  Automatic Fall Monitoring: A Review , 2014, Sensors.

[27]  Bogdan Kwolek,et al.  Human fall detection on embedded platform using depth maps and wireless accelerometer , 2014, Comput. Methods Programs Biomed..

[28]  Bogdan Kwolek,et al.  Fuzzy Inference-Based Reliable Fall Detection Using Kinect and Accelerometer , 2012, ICAISC.

[29]  A K Bourke,et al.  Evaluation of a threshold-based tri-axial accelerometer fall detection algorithm. , 2007, Gait & posture.