Fall Detection Using Convolutional Neural Network With Multi-Sensor Fusion

In this paper, a fall detection method is proposed by employing deep learning and multi-sensors fusion. Continuous wave radar and optical cameras are used simultaneously to capture human action information. Based on the abstraction of both the microwave and optical characteristics of the captured information, multiple convolutional neural network (CNN) is used to realize the information training and fall action recognition. Due to the fusion of multi-sensor information, the overall performance of the fall detection system can be improved remarkably. Detailed experiments are given to validate the proposed method.

[1]  Wenbing Tao,et al.  Radar-based fall detection exploiting time-frequency features , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[2]  Pekka Kannus,et al.  Alarming rise in the number and incidence of fall-induced cervical spine injuries among older adults. , 2007, The journals of gerontology. Series A, Biological sciences and medical sciences.

[3]  Ennio Gambi,et al.  Radar and RGB-Depth Sensors for Fall Detection: A Review , 2017, IEEE Sensors Journal.

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[6]  Yun Li,et al.  A Microphone Array System for Automatic Fall Detection , 2012, IEEE Transactions on Biomedical Engineering.

[7]  Alessio Balleri,et al.  Recognition of humans based on radar micro-Doppler shape spectrum features , 2015 .

[8]  Chin-Feng Lai,et al.  Detection of Cognitive Injured Body Region Using Multiple Triaxial Accelerometers for Elderly Falling , 2011, IEEE Sensors Journal.

[9]  Nadia Magnenat-Thalmann,et al.  Fall Detection Based on Body Part Tracking Using a Depth Camera , 2015, IEEE Journal of Biomedical and Health Informatics.

[10]  M. Tinetti,et al.  Predictors and prognosis of inability to get up after falls among elderly persons. , 1993, JAMA.

[11]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[12]  L. Rubenstein Falls in older people: epidemiology, risk factors and strategies for prevention. , 2006, Age and ageing.

[13]  Nigel H. Lovell,et al.  Spectral Analysis of Accelerometry Signals From a Directed-Routine for Falls-Risk Estimation , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Liang Liu,et al.  Automatic fall detection based on Doppler radar motion signature , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[15]  Feng Zhou,et al.  Textural feature extraction based on time–frequency spectrograms of humans and vehicles , 2015 .

[16]  Senem Velipasalar,et al.  Automatic Fall Detection and Activity Classification by a Wearable Embedded Smart Camera , 2013, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.