Device-Free RF Human Body Fall Detection and Localization in Industrial Workplaces

Fall detection and localization of human operators inside a workspace are major issues in ensuring a safe working environment. Recent research has shown that the perturbations of the radio-frequency (RF) signals commonly adopted for wireless communications can also be used as sensing tools for device-free human motion detection. Device-free RF-based human sensing applications range from tag-less body localization to detection and monitoring of human well-being (e-Health). In this paper, we propose a real-time system for human body motion sensing with special focus on joint body localization and fall detection. The proposed system continuously monitors and processes the RF signals emitted by industry-compliant radio devices operating in the 2.4 GHz ISM band and supporting machine-to-machine communication functions. Human-induced diffraction and multipath phenomena that affect RF signal propagation are leveraged for body localization while for fall detection a hidden Markov model is applied to discern different postures of the operator and to detect safety-relevant events by tracking the received signal strength indicator footprints. Fall detection performances are corroborated by extensive experimental measurements in different settings. In addition, we propose also a sensor fusion tool that is able to integrate the device-free RF-based sensing system within an industrial image sensors framework. Preliminary results, conducted during field trial measurements, confirm the effectiveness of the proposed approach in terms of localization accuracy, and sensitivity/specificity to correctly detect a fall event from preimpact postures.

[1]  R.L. Moses,et al.  Locating the nodes: cooperative localization in wireless sensor networks , 2005, IEEE Signal Processing Magazine.

[2]  Monica Nicoli,et al.  Physical Modeling and Performance Bounds for Device-free Localization Systems , 2015, IEEE Signal Processing Letters.

[3]  T. Teixeira,et al.  A Survey of Human-Sensing : Methods for Detecting Presence , Count , Location , Track , and Identity , 2010 .

[4]  Neal Patwari,et al.  Radio Tomographic Imaging with Wireless Networks , 2010, IEEE Transactions on Mobile Computing.

[5]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[6]  Matti Linnavuo,et al.  Detection of falls among the elderly by a floor sensor using the electric near field , 2010, IEEE Transactions on Information Technology in Biomedicine.

[7]  Vittorio Rampa,et al.  Leveraging RF signals for human sensing: Fall detection and localization in human-machine shared workspaces , 2015, 2015 IEEE 13th International Conference on Industrial Informatics (INDIN).

[8]  Ravi Kumar Karri,et al.  Sensor Data Fusion Using Kalman Filter , 2018, 2018 International Conference on Design Innovations for 3Cs Compute Communicate Control (ICDI3C).

[9]  Miguel A. Labrador,et al.  Human Activity Recognition: Using Wearable Sensors and Smartphones , 2013 .

[10]  Kang Lee,et al.  IEEE 1588 standard for a precision clock synchronization protocol for networked measurement and control systems , 2002, 2nd ISA/IEEE Sensors for Industry Conference,.

[11]  Nadjib Badache,et al.  Event-Aware Framework for Dynamic Services Discovery and Selection in the Context of Ambient Intelligence and Internet of Things , 2016, IEEE Transactions on Automation Science and Engineering.

[12]  Yusheng Ji,et al.  RF-Sensing of Activities from Non-Cooperative Subjects in Device-Free Recognition Systems Using Ambient and Local Signals , 2014, IEEE Transactions on Mobile Computing.

[13]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Vittorio Rampa,et al.  Device-Free Human Sensing and Localization in Collaborative Human–Robot Workspaces: A Case Study , 2016, IEEE Sensors Journal.

[15]  G. Weiss,et al.  Random Walks: Theory and Selected Applications , 2007 .

[16]  Moustafa Youssef,et al.  Device-Free Radio-based Low Overhead Identification of Subject Classes , 2015, WPA@MobiSys.

[17]  Li-Chen Fu,et al.  Spatio-temporal Feature Enhanced Semi-supervised Adaptation for Activity Recognition in IoT-Based Context-Aware Smart Homes , 2013, 2013 IEEE International Conference on Green Computing and Communications and IEEE Internet of Things and IEEE Cyber, Physical and Social Computing.

[18]  L. Roselli,et al.  No Battery Required: Perpetual RFID-Enabled Wireless Sensors for Cognitive Intelligence Applications , 2013, IEEE Microwave Magazine.

[19]  Moustafa Youssef,et al.  Ichnaea: A Low-Overhead Robust WLAN Device-Free Passive Localization System , 2014, IEEE Journal of Selected Topics in Signal Processing.

[20]  Yun Li,et al.  A Microphone Array System for Automatic Fall Detection , 2012, IEEE Transactions on Biomedical Engineering.

[21]  Jing Liu,et al.  Survey of Wireless Indoor Positioning Techniques and Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[22]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[23]  A.G.O. Mutambara Information based estimation for both linear and nonlinear systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[24]  Fatimah Ibrahim,et al.  Smartphone-Based Solutions for Fall Detection and Prevention: Challenges and Open Issues , 2014, Sensors.

[25]  Umberto Spagnolini,et al.  Device-Free Radio Vision for Assisted Living: Leveraging wireless channel quality information for human sensing , 2016, IEEE Signal Processing Magazine.

[26]  Branko G Celler,et al.  Unsupervised machine-learning method for improving the performance of ambulatory fall-detection systems , 2012, BioMedical Engineering OnLine.

[27]  Wu He,et al.  Internet of Things in Industries: A Survey , 2014, IEEE Transactions on Industrial Informatics.

[28]  S. Gevorgian Ferroelectrics in Microwave Devices, Circuits and Systems , 2009 .

[29]  Falko Dressler,et al.  An IEEE 802.11a/g/p OFDM receiver for GNU radio , 2013, SRIF '13.

[30]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[31]  Monica Nicoli,et al.  Pre-deployment performance assessment of device-free radio localization systems , 2016, 2016 IEEE International Conference on Communications Workshops (ICC).

[32]  Xiang Chen,et al.  A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals , 2013, IEEE Journal of Biomedical and Health Informatics.

[33]  Ping-Min Lin,et al.  A fall detection system using k-nearest neighbor classifier , 2010, Expert Syst. Appl..