iWash: A smartwatch handwashing quality assessment and reminder system with real-time feedback in the context of infectious disease

Washing hands properly and frequently is the simplest and most cost-effective interventions to prevent the spread of infectious diseases. People are often ignorant about proper handwashing in different situations and do not know if they wash hands properly. Smartwatches are found to be effective for assessing the quality of handwashing. However, the existing smartwatch based systems are not comprehensive enough in terms of achieving accuracy as well as reminding people to handwash and providing feedback to the user about the quality of handwashing. On-device processing is often required to provide real-time feedback to the user, and so it is important to develop a system that runs efficiently on low-resource devices like smartwatches. However, none of the existing systems for handwashing quality assessment are optimized for on-device processing. We present iWash, a comprehensive system for quality assessment and context-aware reminders for handwashing with real-time feedback using smartwatches. iWash is a hybrid deep neural network based system that is optimized for on-device processing to ensure high accuracy with minimal processing time and battery usage. Additionally, it is a context-aware system that detects when the user is entering home using a Bluetooth beacon and provides reminders to wash hands. iWash also offers touch-free interaction between the user and the smartwatch that minimizes the risk of germ transmission. We collected a real-life dataset and conducted extensive evaluations to demonstrate the performance of iWash. Compared to existing handwashing quality assessment systems, we achieve around 12% higher accuracy for quality assessment, as well as we reduce the processing time and battery usage by around 37% and 10%, respectively.

[1]  Marta Elena Losa-Iglesias,et al.  Footwear used by older people and a history of hyperkeratotic lesions on the foot , 2017, Medicine.

[2]  John A. Stankovic,et al.  Harmony: A Hand Wash Monitoring and Reminder System using Smart Watches , 2015, EAI Endorsed Trans. Ambient Syst..

[3]  John M. Boyce,et al.  Electronic monitoring in combination with direct observation as a means to significantly improve hand hygiene compliance , 2017, American journal of infection control.

[4]  Xiaojun Chang,et al.  Block-Wisely Supervised Neural Architecture Search With Knowledge Distillation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  R. Taylor,et al.  Electronic surveillance of wall-mounted soap and alcohol gel dispensers in an intensive care unit. , 2007, The Journal of hospital infection.

[6]  Jesse Hoey,et al.  Automated handwashing assistance for persons with dementia using video and a partially observable Markov decision process , 2010, Comput. Vis. Image Underst..

[7]  Peter Andras,et al.  On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution , 2013, ISWC '13.

[8]  Tamás Haidegger,et al.  A large-scale assessment of hand hygiene quality and the effectiveness of the “WHO 6-steps” , 2013, BMC Infectious Diseases.

[9]  Song Han,et al.  AMC: AutoML for Model Compression and Acceleration on Mobile Devices , 2018, ECCV.

[10]  N. Habashi,et al.  1187 , 2019, Critical Care Medicine.

[11]  Gerard Lacey,et al.  Hand Hygiene Poses Recognition with RGB-D Videos , 2015 .

[12]  Jason Fletcher,et al.  A comparison of scheduling, work hours, overtime, and work preferences across four cohorts of newly licensed Registered Nurses. , 2019, Journal of advanced nursing.

[13]  Robert Kozielski Why, How, What? , 2017 .

[14]  Vassilis Kostakos,et al.  Accurate Measurement of Handwash Quality Using Sensor Armbands: Instrument Validation Study , 2020, JMIR mHealth and uHealth.

[15]  H. G. Garcell,et al.  Assessment of hand hygiene techniques using the World Health Organization's six steps. , 2016, Journal of infection and public health.

[16]  Sarah Tschudin-Sutter,et al.  Compliance with the World Health Organization Hand Hygiene Technique: A Prospective Observational Study , 2015, Infection Control & Hospital Epidemiology.

[17]  B. Allegranzi,et al.  Role of hand hygiene in healthcare-associated infection prevention. , 2009, The Journal of hospital infection.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Ted Herman,et al.  Hand hygiene duration and technique recognition using wrist-worn sensors , 2015, IPSN.

[20]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[21]  Abien Fred Agarap Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[22]  Sirat Samyoun,et al.  Stress Detection via Sensor Translation , 2020, 2020 16th International Conference on Distributed Computing in Sensor Systems (DCOSS).

[23]  Gregory D. Abowd,et al.  Wristwash: towards automatic handwashing assessment using a wrist-worn device , 2018, UbiComp.

[24]  Angela Tavares Paes,et al.  Measuring Rates of Hand Hygiene Adherence in the Intensive Care Setting: A Comparative Study of Direct Observation, Product Usage, and Electronic Counting Devices , 2010, Infection Control & Hospital Epidemiology.

[25]  John A. Stankovic,et al.  MedRem: an interactive medication reminder and tracking system on wrist devices , 2016, 2016 IEEE Wireless Health (WH).

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Rebecca Schnall,et al.  Review and analysis of existing mobile phone applications for health care-associated infection prevention. , 2015, American journal of infection control.

[28]  Houshang Darabi,et al.  Multivariate LSTM-FCNs for Time Series Classification , 2018, Neural Networks.

[29]  John A. Stankovic,et al.  iAdhere: A voice interactive assistant to improve adherence to medical treatments: demo abstract , 2019, ICCPS.

[30]  Mushfiqul Alam,et al.  Adaptive Data Filtering of Inertial Sensors with Variable Bandwidth , 2014, Sensors.

[31]  Y. Longtin,et al.  1187. Estimation of Individual Healthcare Workers’ Relative Hand Hygiene Compliance Using an Anonymous Electronic Monitoring System , 2019, Open Forum Infectious Diseases.

[32]  Uichin Lee,et al.  Smartwatch Wearing Behavior Analysis , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[33]  Gerard Lacey,et al.  A vision-based system for automatic hand washing quality assessment , 2011, Machine Vision and Applications.