Room-Level Fall Detection Based on Ultra-Wideband (UWB) Monostatic Radar and Convolutional Long Short-Term Memory (LSTM)

Timely calls for help can really make a difference for elders who suffer from falls, particularly in private locations. Considering privacy protection and convenience for the users, in this paper, we approach the problem by using impulse–radio ultra-wideband (IR-UWB) monostatic radar and propose a learning model that combines convolutional layers and convolutional long short term memory (ConvLSTM) to extract robust spatiotemporal features for fall detection. The performance of the proposed scheme was evaluated in terms of accuracy, sensitivity, and specificity. The results show that the proposed method outperforms convolutional neural network (CNN)-based methods. Of the six activities we investigated, the proposed method can achieve a sensitivity of 95% and a specificity of 92.6% at a range of 8 meters. Further tests in a heavily furnished lounge environment showed that the model can detect falls with more than 90% sensitivity, even without re-training effort. The proposed method can detect falls without exposing the identity of the users. Thus, the proposed method is ideal for room-level fall detection in privacy-prioritized scenarios.

[1]  Stelios C. A. Thomopoulos,et al.  An indoor localization platform for ambient assisted living using UWB , 2008, MoMM.

[2]  Bo Yang,et al.  Multi-target device-free tracking using radio frequency tomography , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[3]  Ruizhi Chen,et al.  Scene Recognition for Indoor Localization Using a Multi-Sensor Fusion Approach , 2017, Sensors.

[4]  Shyamnath Gollakota,et al.  Feasibility and limits of wi-fi imaging , 2014, SenSys.

[5]  Jing Liang,et al.  A Differential Based Approach for Sense-Through-Foliage Target Detection Using UWB Radar Sensor Networks , 2008, 2008 IEEE International Conference on Communications.

[6]  Sreeraman Rajan,et al.  Fall Detection Using Standoff Radar-Based Sensing and Deep Convolutional Neural Network , 2020, IEEE Transactions on Circuits and Systems II: Express Briefs.

[7]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[8]  Sreeraman Rajan,et al.  Residual Network-Based Supervised Learning of Remotely Sensed Fall Incidents using Ultra-Wideband Radar , 2019, 2019 IEEE International Symposium on Circuits and Systems (ISCAS).

[9]  Youngwook Kim,et al.  Human Activity Classification With Transmission and Reflection Coefficients of On-Body Antennas Through Deep Convolutional Neural Networks , 2017, IEEE Transactions on Antennas and Propagation.

[10]  Ling Shao,et al.  A survey on fall detection: Principles and approaches , 2013, Neurocomputing.

[11]  Kaishun Wu,et al.  WiFall: Device-free fall detection by wireless networks , 2017, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[12]  Lingmei Ren,et al.  Research of Fall Detection and Fall Prevention Technologies: A Systematic Review , 2019, IEEE Access.

[13]  F. Fioranelli,et al.  Human Activity Classification With Radar: Optimization and Noise Robustness With Iterative Convolutional Neural Networks Followed With Random Forests , 2018, IEEE Sensors Journal.

[14]  Emmanuel Andrès,et al.  From Fall Detection to Fall Prevention: A Generic Classification of Fall-Related Systems , 2017, IEEE Sensors Journal.

[15]  Matthias Pätzold,et al.  A Machine Learning Approach for Fall Detection Based on the Instantaneous Doppler Frequency , 2019, IEEE Access.

[16]  Gu-Min Jeong,et al.  Daily wrist activity classification using a smart band , 2017, Physiological measurement.

[17]  Xiaoguang Liu,et al.  A New Approach to Fall Detection Based on Improved Dual Parallel Channels Convolutional Neural Network , 2019, Sensors.

[18]  D. Altman,et al.  Statistics Notes: Diagnostic tests 1: sensitivity and specificity , 1994 .

[19]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[20]  Jae-Young Pyun,et al.  Location Detection and Tracking of Moving Targets by a 2D IR-UWB Radar System , 2015, Sensors.

[21]  J. Stevens,et al.  The direct costs of fatal and non-fatal falls among older adults - United States. , 2016, Journal of safety research.

[22]  M. V. Van Natta,et al.  Risk factors associated with falls and injuries among elderly institutionalized persons. , 1991, American journal of epidemiology.

[23]  Tao Zhang,et al.  An Adaptive S-Method to Analyze Micro-Doppler Signals for Human Activity Classification , 2017, Sensors.

[24]  Jing Liang,et al.  Foliage Clutter Modeling Using the UWB Radar , 2008, 2008 IEEE International Conference on Communications.

[25]  M. Tinetti,et al.  Risk factors for falls among elderly persons living in the community. , 1988, The New England journal of medicine.

[26]  Wee Peng Tay,et al.  LaIF: A Lane-Level Self-Positioning Scheme for Vehicles in GNSS-Denied Environments , 2019, IEEE Transactions on Intelligent Transportation Systems.

[27]  Sung Ho Cho,et al.  IR-UWB Radar Sensor for Human Gesture Recognition by Using Machine Learning , 2016, 2016 IEEE 18th International Conference on High Performance Computing and Communications; IEEE 14th International Conference on Smart City; IEEE 2nd International Conference on Data Science and Systems (HPCC/SmartCity/DSS).

[28]  M. Domínguez-Morales,et al.  Wearable Fall Detector Using Recurrent Neural Networks , 2019, Sensors.

[29]  A. Kajiwara,et al.  Accident Detection and Health-Monitoring UWB Sensor in Toilet , 2019, 2019 IEEE Topical Conference on Wireless Sensors and Sensor Networks (WiSNet).

[30]  Changzhan Gu,et al.  A Hybrid FMCW-Interferometry Radar for Indoor Precise Positioning and Versatile Life Activity Monitoring , 2014, IEEE Transactions on Microwave Theory and Techniques.

[31]  Kegen Yu,et al.  Improved Wi-Fi RSSI Measurement for Indoor Localization , 2017, IEEE Sensors Journal.

[32]  Daqing Zhang,et al.  RT-Fall: A Real-Time and Contactless Fall Detection System with Commodity WiFi Devices , 2017, IEEE Transactions on Mobile Computing.

[33]  Junhai Luo,et al.  A Smartphone Indoor Localization Algorithm Based on WLAN Location Fingerprinting with Feature Extraction and Clustering , 2017, Sensors.

[34]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[35]  Ting Jiang,et al.  Target detection and classification by measuring and processing bistatic UWB radar signal , 2014 .

[36]  Qing Zhang,et al.  Fall detection in smart home environments using UWB sensors and unsupervised change detection , 2018, Journal of Reliable Intelligent Environments.

[37]  Qing Zhang,et al.  Human Identification via Unsupervised Feature Learning from UWB Radar Data , 2018, PAKDD.

[38]  Jie Yang,et al.  E-eyes: device-free location-oriented activity identification using fine-grained WiFi signatures , 2014, MobiCom.