Leveraging RF signals for human sensing: Fall detection and localization in human-machine shared workspaces

Safe human-machine interactions promote high flexibility in collaborative workspaces. Fall detection and localization of the operator are major issues in ensuring a safe working environment. However, many proposed solutions are not applicable for deployment in industrial environments due to their performance limitations in practical contexts. In this paper, we propose an integrated framework for both localization and fall detection of operators inside a shared workspace that employs radio-frequency (RF) signal analysis in real-time. Multipath and non-line-of-sight (NLOS) scattering that affect RF signal propagation can be leveraged for human sensing in complex workspaces: the proposed system continuously monitors the fluctuations of the RF field across the space by a dense network of WiFi compliant radio devices operating at 2.4GHz. To increase the accuracy of the localization system, a sensor fusion algorithm using Extended Kalman Filter techniques is employed. The proposed method may be used for integrating measurements from both RF nodes and an additional image-based system. For fall detection, a Hidden Markov Model is applied to discern different postures of the operator and to detect a fall event by tracking the fluctuations of the wireless signal quality. Fall detector performances are validated through experimental measurements. The preliminary results confirm the effectiveness of the proposed approach for different body configurations and pre-impact postures to correctly detect a fall event. Finally, some results about sensor fusion for improved operator localization are presented.

[1]  P. Hartana,et al.  Sensor data fusion using Kalman filter , 2000, Proceedings of the Third International Conference on Information Fusion.

[2]  Alessio Vecchio,et al.  A smartphone-based fall detection system , 2012, Pervasive Mob. Comput..

[3]  A.G.O. Mutambara Information based estimation for both linear and nonlinear systems , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[4]  Eric Wengrowski,et al.  A Survey on Device-Free Passive Localization and Gesture Recognition via Body Wave Reflections , 2014 .

[5]  LiXiaolin,et al.  Training Hidden Markov Models with Multiple Observations-A Combinatorial Method , 2000 .

[6]  G. Weiss,et al.  Random Walks: Theory and Selected Applications , 2007 .

[7]  Ping-Min Lin,et al.  A fall detection system using k-nearest neighbor classifier , 2010, Expert Syst. Appl..

[8]  M. V. Levin The medical engineering industry in the third year of the tenth five-year period , 1978 .

[9]  Jing Liu,et al.  Survey of Wireless Indoor Positioning Techniques and Systems , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[10]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Vittorio Rampa,et al.  Safe human-robot cooperation through sensor-less radio localization , 2014, 2014 12th IEEE International Conference on Industrial Informatics (INDIN).

[12]  Branko G Celler,et al.  Unsupervised machine-learning method for improving the performance of ambulatory fall-detection systems , 2012, BioMedical Engineering OnLine.

[13]  Björn Matthias,et al.  Safety of Industrial Robots: From Conventional to Collaborative Applications , 2012, ROBOTIK.

[14]  Jong-Hoon Youn,et al.  Survey and evaluation of real-time fall detection approaches , 2009, 2009 6th International Symposium on High Capacity Optical Networks and Enabling Technologies (HONET).

[15]  Yunhao Liu,et al.  From RSSI to CSI , 2013, ACM Comput. Surv..

[16]  Monica Nicoli,et al.  A Bayesian Approach to Device-Free Localization: Modeling and Experimental Assessment , 2014, IEEE Journal of Selected Topics in Signal Processing.

[17]  Inmaculada Plaza,et al.  Challenges, issues and trends in fall detection systems , 2013, Biomedical engineering online.

[18]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[19]  Xiang Chen,et al.  A Framework for Daily Activity Monitoring and Fall Detection Based on Surface Electromyography and Accelerometer Signals , 2013, IEEE Journal of Biomedical and Health Informatics.

[20]  S. Foix,et al.  Lock-in Time-of-Flight (ToF) Cameras: A Survey , 2011, IEEE Sensors Journal.

[21]  Fatimah Ibrahim,et al.  Smartphone-Based Solutions for Fall Detection and Prevention: Challenges and Open Issues , 2014, Sensors.

[22]  Frank Sposaro,et al.  iFall: An android application for fall monitoring and response , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Yun Li,et al.  A Microphone Array System for Automatic Fall Detection , 2012, IEEE Transactions on Biomedical Engineering.

[24]  Matti Linnavuo,et al.  Detection of falls among the elderly by a floor sensor using the electric near field , 2010, IEEE Transactions on Information Technology in Biomedicine.

[25]  A. Mathai,et al.  Understanding and using sensitivity, specificity and predictive values , 2008, Indian journal of ophthalmology.