Fall Detection Using Deep Learning in Range-Doppler Radars

In this paper, we propose an approach that uses deep learning to detect a human fall. The proposed approach automatically captures the intricate properties of the radar returns. In order to minimize false alarms, we fuse information from both the time-frequency and range domains. Experimental data is used to demonstrate the superiority of the deep learning based approach in comparison with the principal component analysis method and those methods incorporating predefined physically interpreted features.

[1]  A. Bourke,et al.  A threshold-based fall-detection algorithm using a bi-axial gyroscope sensor. , 2008, Medical engineering & physics.

[2]  Youngwook Kim,et al.  Human Activity Classification Based on Micro-Doppler Signatures Using a Support Vector Machine , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Marjorie Skubic,et al.  Doppler Radar Fall Activity Detection Using the Wavelet Transform , 2015, IEEE Transactions on Biomedical Engineering.

[4]  Wenbing Tao,et al.  Radar-based fall detection exploiting time-frequency features , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[5]  Shyamal Patel,et al.  A review of wearable sensors and systems with application in rehabilitation , 2012, Journal of NeuroEngineering and Rehabilitation.

[6]  Victor C. Chen,et al.  Analysis of radar micro-Doppler with time-frequency transform , 2000, Proceedings of the Tenth IEEE Workshop on Statistical Signal and Array Processing (Cat. No.00TH8496).

[7]  Carmine Clemente,et al.  Developments in target micro-Doppler signatures analysis: radar imaging, ultrasound and through-the-wall radar , 2013, EURASIP J. Adv. Signal Process..

[8]  Boualem Boashash,et al.  Radar fall detection using principal component analysis , 2016, SPIE Defense + Security.

[9]  Changzhi Li,et al.  FMCW radar fall detection based on ISAR processing utilizing the properties of RCS, range, and Doppler , 2016, 2016 IEEE MTT-S International Microwave Symposium (IMS).

[10]  Jean Meunier,et al.  Fall Detection from Human Shape and Motion History Using Video Surveillance , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[11]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[12]  Branka Jokanovic,et al.  Multi-window time–frequency signature reconstruction from undersampled continuous-wave radar measurements for fall detection , 2015 .

[13]  Carmine Clemente,et al.  A novel algorithm for radar classification based on doppler characteristics exploiting orthogonal Pseudo-Zernike polynomials , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[14]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Moeness Amin,et al.  Radar for Indoor Monitoring: Detection, Classification, and Assessment , 2017 .

[16]  Min Chen,et al.  Smart Clothing: Connecting Human with Clouds and Big Data for Sustainable Health Monitoring , 2016, Mobile Networks and Applications.

[17]  Yeh-Liang Hsu,et al.  A Review of Accelerometry-Based Wearable Motion Detectors for Physical Activity Monitoring , 2010, Sensors.

[18]  Dave Tahmoush,et al.  Time-integrated range-Doppler maps for visualizing and classifying radar data , 2011, 2011 IEEE RadarCon (RADAR).

[19]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[20]  Moeness G. Amin,et al.  Fall motion detection using combined range and Doppler features , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[21]  Ali Cafer Gürbüz,et al.  Importance ranking of features for human micro-Doppler classification with a radar network , 2013, Proceedings of the 16th International Conference on Information Fusion.

[22]  Gang Zhou,et al.  Accurate, Fast Fall Detection Using Gyroscopes and Accelerometer-Derived Posture Information , 2009, 2009 Sixth International Workshop on Wearable and Implantable Body Sensor Networks.

[23]  Franck Multon,et al.  Fall Detection With Multiple Cameras: An Occlusion-Resistant Method Based on 3-D Silhouette Vertical Distribution , 2011, IEEE Transactions on Information Technology in Biomedicine.

[24]  Branka Jokanovic,et al.  Effect of data representations on deep learning in fall detection , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[25]  J. Stevens,et al.  The direct costs of fatal and non-fatal falls among older adults - United States. , 2016, Journal of safety research.

[26]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[27]  G. Bergen,et al.  Falls and Fall Injuries Among Adults Aged ≥65 Years - United States, 2014. , 2016, MMWR. Morbidity and mortality weekly report.

[28]  Liang Liu,et al.  Automatic fall detection based on Doppler radar motion signature , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[29]  P. Leroux,et al.  SFCW microwave radar for in-door fall detection , 2012, 2012 IEEE Topical Conference on Biomedical Wireless Technologies, Networks, and Sensing Systems (BioWireleSS).

[30]  F. Groen,et al.  Human walking estimation with radar , 2003 .

[31]  Youngwook Kim,et al.  Classification of human activity on water through micro-Dopplers using deep convolutional neural networks , 2016, SPIE Defense + Security.

[32]  Wenbing Tao,et al.  Radar-based fall detection based on Doppler time-frequency signatures for assisted living , 2015 .

[33]  Branka Jokanovic,et al.  Radar fall motion detection using deep learning , 2016, 2016 IEEE Radar Conference (RadarConf).

[34]  Marco Mercuri,et al.  Embedded DSP-Based Telehealth Radar System for Remote In-Door Fall Detection , 2015, IEEE Journal of Biomedical and Health Informatics.

[35]  Hao Ling,et al.  Human activity classification based on micro-Doppler signatures using an artificial neural network , 2008, 2008 IEEE Antennas and Propagation Society International Symposium.

[36]  Hlaing Minn,et al.  Real-Time Sleep Apnea Detection by Classifier Combination , 2012, IEEE Transactions on Information Technology in Biomedicine.

[37]  Moeness G. Amin,et al.  Effects of range spread and aspect angle on radar fall detection , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[38]  Bijan G. Mobasseri,et al.  A time-frequency classifier for human gait recognition , 2009, Defense + Commercial Sensing.

[39]  Dong Xuan,et al.  PerFallD: A pervasive fall detection system using mobile phones , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[40]  Mohamed S. Kamel,et al.  Integrating Heterogeneous Classifier Ensembles for EMG Signal Decomposition Based on Classifier Agreement , 2010, IEEE Transactions on Information Technology in Biomedicine.

[41]  R. Bajcsy,et al.  Wearable Sensors for Reliable Fall Detection , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[42]  Kenneth Meijer,et al.  Activity identification using body-mounted sensors—a review of classification techniques , 2009, Physiological measurement.

[43]  Rita Cucchiara,et al.  A multi‐camera vision system for fall detection and alarm generation , 2007, Expert Syst. J. Knowl. Eng..