Automated Cluster Detection of Health Care–Associated Infection Based on the Multisource Surveillance of Process Data in the Area Network: Retrospective Study of Algorithm Development and Validation (Preprint)

BACKGROUND The cluster detection of health care–associated infections (HAIs) is crucial for identifying HAI outbreaks in the early stages. OBJECTIVE We aimed to verify whether multisource surveillance based on the process data in an area network can be effective in detecting HAI clusters. METHODS We retrospectively analyzed the incidence of HAIs and 3 indicators of process data relative to infection, namely, antibiotic utilization rate in combination, inspection rate of bacterial specimens, and positive rate of bacterial specimens, from 4 independent high-risk units in a tertiary hospital in China. We utilized the Shewhart warning model to detect the peaks of the time-series data. Subsequently, we designed 5 surveillance strategies based on the process data for the HAI cluster detection: (1) antibiotic utilization rate in combination only, (2) inspection rate of bacterial specimens only, (3) positive rate of bacterial specimens only, (4) antibiotic utilization rate in combination + inspection rate of bacterial specimens + positive rate of bacterial specimens in parallel, and (5) antibiotic utilization rate in combination + inspection rate of bacterial specimens + positive rate of bacterial specimens in series. We used the receiver operating characteristic (ROC) curve and Youden index to evaluate the warning performance of these surveillance strategies for the detection of HAI clusters. RESULTS The ROC curves of the 5 surveillance strategies were located above the standard line, and the area under the curve of the ROC was larger in the parallel strategy than in the series strategy and the single-indicator strategies. The optimal Youden indexes were 0.48 (95% CI 0.29-0.67) at a threshold of 1.5 in the antibiotic utilization rate in combination–only strategy, 0.49 (95% CI 0.45-0.53) at a threshold of 0.5 in the inspection rate of bacterial specimens–only strategy, 0.50 (95% CI 0.28-0.71) at a threshold of 1.1 in the positive rate of bacterial specimens–only strategy, 0.63 (95% CI 0.49-0.77) at a threshold of 2.6 in the parallel strategy, and 0.32 (95% CI 0.00-0.65) at a threshold of 0.0 in the series strategy. The warning performance of the parallel strategy was greater than that of the single-indicator strategies when the threshold exceeded 1.5. CONCLUSIONS The multisource surveillance of process data in the area network is an effective method for the early detection of HAI clusters. The combination of multisource data and the threshold of the warning model are 2 important factors that influence the performance of the model.

[1]  D. Glez-Peña,et al.  Gold Standard Evaluation of an Automatic HAIs Surveillance System , 2019, BioMed research international.

[2]  Anil Vullikanti,et al.  Fast and near-optimal monitoring for healthcare acquired infection outbreaks , 2019, PLoS Comput. Biol..

[3]  F. Gao,et al.  Data on antibiotic use for detecting clusters of healthcare-associated infection caused by multidrug-resistant organisms in a hospital in China, 2014 to 2017. , 2019, The Journal of hospital infection.

[4]  G. Snyder,et al.  Automated data mining of the electronic health record for investigation of healthcare-associated outbreaks , 2019, Infection Control & Hospital Epidemiology.

[5]  Stéfan Jacques Darmoni,et al.  Accuracy of using natural language processing methods for identifying healthcare-associated infections , 2018, Int. J. Medical Informatics.

[6]  William A. Mattingly,et al.  Methods for computational disease surveillance in infection prevention and control: Statistical process control versus Twitter's anomaly and breakout detection algorithms , 2017, American journal of infection control.

[7]  D. Buckeridge,et al.  Automated detection of hospital outbreaks: A systematic review of methods , 2017, PloS one.

[8]  J. Revelly,et al.  Antibiotic consumption to detect epidemics of Pseudomonas aeruginosa in a burn centre: A paradigm shift in the epidemiological surveillance of Pseudomonas aeruginosa nosocomial infections. , 2016, Burns : journal of the International Society for Burn Injuries.

[9]  Zhiyuan Yao,et al.  Annual surveys for point-prevalence of healthcare-associated infection in a tertiary hospital in Beijing, China, 2012-2014 , 2016, BMC Infectious Diseases.

[10]  P. Vanhems,et al.  Detection of Temporal Clusters of Healthcare-Associated Infections or Colonizations with Pseudomonas aeruginosa in Two Hospitals: Comparison of SaTScan and WHONET Software Packages , 2015, PloS one.

[11]  Biao Xu,et al.  Evaluation of Outbreak Detection Performance Using Multi-Stream Syndromic Surveillance for Influenza-Like Illness in Rural Hubei Province, China: A Temporal Simulation Model Based on Healthcare-Seeking Behaviors , 2014, PloS one.

[12]  B. Leclère,et al.  Matching Bacteriological and Medico-Administrative Databases Is Efficient for a Computer-Enhanced Surveillance of Surgical Site Infections: Retrospective Analysis of 4,400 Surgical Procedures in a French University Hospital , 2014, Infection Control & Hospital Epidemiology.

[13]  Biao Xu,et al.  Estimating the Effectiveness of Early Control Measures through School Absenteeism Surveillance in Observed Outbreaks at Rural Schools in Hubei, China , 2014, PloS one.

[14]  A Charlett,et al.  Advances in electronic surveillance for healthcare-associated infections in the 21st Century: a systematic review. , 2013, The Journal of hospital infection.

[15]  R. Chioléro,et al.  Five-Year Evolution of Drug Prescribing in a University Adult Intensive Care Unit , 2012, Applied Health Economics and Health Policy.

[16]  A Lepape,et al.  Automated detection of nosocomial infections: evaluation of different strategies in an intensive care unit 2000-2006. , 2011, The Journal of hospital infection.

[17]  B. Allegranzi,et al.  Burden of endemic health-care-associated infection in developing countries: systematic review and meta-analysis , 2011, The Lancet.

[18]  P. Gastmeier,et al.  Worldwide Outbreak Database: the largest collection of nosocomial outbreaks , 2010, Infection.

[19]  J Leal,et al.  Validity of electronic surveillance systems: a systematic review. , 2008, The Journal of hospital infection.

[20]  U Fedeli,et al.  Linkage of microbiology reports and hospital discharge diagnoses for surveillance of surgical site infections. , 2005, The Journal of hospital infection.

[21]  K. Hiroki,et al.  Early Warning , 1964, International Journal of Clinical Practice.

[22]  Liu Yunxi.  Hospital communicable disease real time monitoring and early warning system function design and practice , 2013 .

[23]  C. Ping.  Epidemiological characteristics and preventive strategies of nosocomial infection outbreak incidents in China in recent 30 years , 2010 .