Thermal Imaging Based Elderly Fall Detection

Elderly fall detection is very special case of human action recognition from videos and has very practical application in old age home and nursing centers. Fall detection in its simplest form is a binary classification of fall event or other daily routine activities. Hence, the current trend of sophisticated techniques being developed for human action recognition, particularly with scenarios of large number of classes may not be required in elderly fall detection. However, other design considerations such as simplicity (ready to be deployed), privacy issues (not revealing the identity) are to focused and are the major contributions of this paper. The Spatio-Temporal Interest Points (STIP) and Fisher vector framework for human action recognition is established as baseline in this work. A novel optical flow based technique is proposed that yields better performance than the baseline. Further, a very economical thermal imaging based input modality is proposed. Along with the thermal images not revealing the identity of the persons, thermal images also aid human detection from backgrounds – a useful solution in computing the optical flow of human movements. The proposed solution is also validated on the KUL Simulated Fall dataset showing its generalization capability.

[1]  C. Brayne,et al.  Inability to get up after falling, subsequent time on floor, and summoning help: prospective cohort study in people over 90 , 2008, BMJ : British Medical Journal.

[2]  Ivan Laptev,et al.  On Space-Time Interest Points , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[4]  Bart Vanrumste,et al.  Bridging the gap between real-life data and simulated data by providing a highly realistic fall dataset for evaluating camera-based fall detection algorithms. , 2016, Healthcare technology letters.

[5]  Bart Vanrumste,et al.  Camera-Based Fall Detection on Real World Data , 2011, Theoretical Foundations of Computer Vision.

[6]  Jeffrey M. Hausdorff,et al.  Evaluation of Accelerometer-Based Fall Detection Algorithms on Real-World Falls , 2012, PloS one.

[7]  Florent Perronnin,et al.  Fisher Kernels on Visual Vocabularies for Image Categorization , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Bart Vanrumste,et al.  Fall incidents unraveled: a series of 26 video-based real-life fall events in three frail older persons , 2013, BMC Geriatrics.

[9]  Jun Liu,et al.  Anatomical Brain Images Alone Can Accurately Diagnose Chronic Neuropsychiatric Illnesses , 2012, PloS one.

[10]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[11]  Ian S G Noble,et al.  Are national qualifying examinations a fair way to rank medical students? No , 2008, BMJ : British Medical Journal.

[12]  Rached Tourki,et al.  Definition and Performance Evaluation of a Robust SVM Based Fall Detection Solution , 2012, 2012 Eighth International Conference on Signal Image Technology and Internet Based Systems.

[13]  Roland Göcke,et al.  The Influence of Temporal Information on Human Action Recognition with Large Number of Classes , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[14]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.

[15]  Matti Linnavuo,et al.  Detection of falls among the elderly by a floor sensor using the electric near field , 2010, IEEE Transactions on Information Technology in Biomedicine.

[16]  L Nyberg,et al.  Comparison of real-life accidental falls in older people with experimental falls in middle-aged test subjects. , 2012, Gait & posture.

[17]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[18]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .