RFWash: a weakly supervised tracking of hand hygiene technique

Each year, hundreds of thousands of people contract Healthcare Associated Infections (HAIs). Poor hand hygiene compliance among healthcare workers is thought to be the leading cause of HAIs and methods were developed to measure compliance. Surprisingly, human observation is still considered the gold standard for measuring compliance by World Health Organization (WHO). Moreover, no automated solutions exist for monitoring hand hygiene techniques, such as "how to hand rub" technique by WHO. In this paper, we introduce RFWash; the first radio-based device-free system for monitoring Hand Hygiene (HH) technique. On the technical level, HH gestures are performed back-to-back in a continuous sequence and pose a significant challenge to conventional two-stage gesture detection and recognition approaches. We propose a deep model that can be trained on unsegmented naturally-performed HH gesture sequences. RFWash evaluation demonstrates promising results for tracking HH gestures, achieving gesture error rate of < 8% when trained on 10-second segments, which reduces manual labelling overhead by ≈ 67% compared to fully supervised approach. The work is a step towards practical RF sensing that can reliably operate inside future healthcare facilities.

[1]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Qian Zhang,et al.  RFID based real-time recognition of ongoing gesture with adversarial learning , 2019, SenSys.

[3]  Yuan Yuan,et al.  In-Home Daily-Life Captioning Using Radio Signals , 2020, ECCV.

[4]  Andrew Markham,et al.  See through smoke: robust indoor mapping with low-cost mmWave radar , 2020, MobiSys.

[5]  John M Boyce,et al.  Measuring Healthcare Worker Hand Hygiene Activity: Current Practices and Emerging Technologies , 2011, Infection Control &#x0026; Hospital Epidemiology.

[6]  Changshui Zhang,et al.  Connectionist Temporal Classification with Maximum Entropy Regularization , 2018, NeurIPS.

[7]  Meng Jin,et al.  mmVib: micrometer-level vibration measurement with mmwave radar , 2020, MobiCom.

[8]  Gerard Lacey,et al.  A vision-based system for automatic hand washing quality assessment , 2011, Machine Vision and Applications.

[9]  Li Fei-Fei,et al.  Towards Vision-Based Smart Hospitals: A System for Tracking and Monitoring Hand Hygiene Compliance , 2017, MLHC.

[10]  Jürgen Schmidhuber,et al.  Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks , 2006, ICML.

[11]  Li Fei-Fei,et al.  Privacy-Preserving Action Recognition for Smart Hospitals using Low-Resolution Depth Images , 2018, ArXiv.

[12]  Pavlo Molchanov,et al.  Online Detection and Classification of Dynamic Hand Gestures with Recurrent 3D Convolutional Neural Networks , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Massimo Piccardi,et al.  The use of privacy-protected computer vision to measure the quality of healthcare worker hand hygiene , 2019, International journal for quality in health care : journal of the International Society for Quality in Health Care.

[14]  Kaishun Wu,et al.  GRfid: A Device-Free RFID-Based Gesture Recognition System , 2017, IEEE Transactions on Mobile Computing.

[15]  E A Benson,et al.  Handwashing: simple but effective. , 1999, Annals of the Royal College of Surgeons of England.

[16]  Xin Xu,et al.  Large-scale gesture recognition with a fusion of RGB-D data based on the C3D model , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[17]  Gregory D. Abowd,et al.  Wristwash: towards automatic handwashing assessment using a wrist-worn device , 2018, UbiComp.

[18]  Song Guo,et al.  ReActor: Real-time and Accurate Contactless Gesture Recognition with RFID , 2019, 2019 16th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON).

[19]  D. Morgan,et al.  Accuracy of a radiofrequency identification (RFID) badge system to monitor hand hygiene behavior during routine clinical activities. , 2014, American journal of infection control.

[20]  Khaled A. Harras,et al.  WiGest: A ubiquitous WiFi-based gesture recognition system , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[21]  Li Fei-Fei,et al.  3D Point Cloud-Based Visual Prediction of ICU Mobility Care Activities , 2018, MLHC.

[22]  Parameswaran Ramanathan,et al.  Leveraging directional antenna capabilities for fine-grained gesture recognition , 2014, UbiComp.

[23]  Ivan Poupyrev,et al.  Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum , 2016, UIST.

[24]  Mary-Louise McLaws,et al.  Automated hand hygiene auditing with and without an intervention. , 2016, American journal of infection control.

[25]  Ran Tao,et al.  Separation of Human Micro-Doppler Signals Based on Short-Time Fractional Fourier Transform , 2019, IEEE Sensors Journal.

[26]  Muhammad Shahzad,et al.  Multi-User Gesture Recognition Using WiFi , 2018, MobiSys.

[27]  Muhammad Shahzad,et al.  Position and Orientation Agnostic Gesture Recognition Using WiFi , 2017, MobiSys.

[28]  Karly A. Smith,et al.  Gesture Recognition Using mm-Wave Sensor for Human-Car Interface , 2018, IEEE Sensors Letters.

[29]  Muhammad Shahzad,et al.  Augmenting User Identification with WiFi Based Gesture Recognition , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[30]  Petri Mähönen,et al.  mm-Wave Radar Based Gesture Recognition: Development and Evaluation of a Low-Power, Low-Complexity System , 2018, mmNets@MobiCom.

[31]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[32]  M. McGuckin,et al.  A Review of Electronic Hand Hygiene Monitoring: Considerations for Hospital Management in Data Collection, Healthcare Worker Supervision, and Patient Perception , 2015, Journal of healthcare management / American College of Healthcare Executives.

[33]  Hao He,et al.  RF-Based Fall Monitoring Using Convolutional Neural Networks , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[34]  Shuangquan Wang,et al.  SignFi , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[35]  Mary-Louise McLaws,et al.  An automated hand hygiene training system improves hand hygiene technique but not compliance. , 2015, American journal of infection control.

[36]  Colin D. Furness,et al.  Quantification of the Hawthorne effect in hand hygiene compliance monitoring using an electronic monitoring system: a retrospective cohort study , 2014, BMJ quality & safety.

[37]  A. Marra,et al.  New technologies to monitor healthcare worker hand hygiene. , 2014, Clinical microbiology and infection : the official publication of the European Society of Clinical Microbiology and Infectious Diseases.

[38]  Xiaonan Guo,et al.  MU-ID: Multi-user Identification Through Gaits Using Millimeter Wave Radios , 2020, IEEE INFOCOM 2020 - IEEE Conference on Computer Communications.

[39]  Mu Zhou,et al.  Latern: Dynamic Continuous Hand Gesture Recognition Using FMCW Radar Sensor , 2018, IEEE Sensors Journal.

[40]  Salil S. Kanhere,et al.  WashInDepth: Lightweight Hand Wash Monitor Using Depth Sensor , 2016, MobiQuitous.

[41]  Sandeep Rao,et al.  Real-Time Multi-Gesture Recognition using 77 GHz FMCW MIMO Single Chip Radar , 2019, 2019 IEEE International Conference on Consumer Electronics (ICCE).

[42]  Chris Van Hoof,et al.  Vital-sign monitoring and spatial tracking of multiple people using a contactless radar-based sensor , 2019, Nature Electronics.