An Intranet-Based Automated System for the Surveillance of Nosocomial Infections: Prospective Validation Compared with Physicians' Self-Reports

Abstract Objective: To examine the reliability of the data produced by an automated system for the surveillance of nosocomial infections. Setting: A 906-bed, tertiary-care teaching hospital. Design: Three surveillance techniques were concurrently performed in seven high-risk units during an 11-week period: automated surveillance (AS) based on the prospective processing of computerized medical records; laboratory-based ward surveillance (LBWS) based on the retrospective verification by ward clinicians of weekly reports of positive bacteriologic results; and a reference standard (RS) consisting of the infection control team reviewing case records of patients with positive bacteriology results. Bacteremia, urinary tract infections, and catheter-related infections were recorded for all inpatients. The performances (sensitivity, specificity, and time consumption) of AS and LBWS were compared with those of RS. Results: Of 548 positive bacteriology samples included during the study period, 229 (42%) were classified as nosocomial infections. The overall sensitivity was 91% and 59% for AS and LBWS, respectively. The two methods had the same overall specificity value (91%). Kappa measures of agreement were 0.81 and 0.54 for AS and LBWS, respectively. AS required less time to collect data (54 seconds per week per unit) compared with LBWS (7 minutes and 43 seconds per week per unit) and RS (37 minutes and 15 seconds per week per unit). Conclusion: Our results confirm that the retrospective review of charts and laboratory data by physicians lacks sensitivity for the surveillance of nosocomial infections. The intranet-based automated method developed for this purpose was more accurate and less time-consuming than the weekly, retrospective LBWS method.

[1]  W. Grove Statistical Methods for Rates and Proportions, 2nd ed , 1981 .

[2]  Éric Lepage,et al.  Development of a Web-based clinical information system for surveillance of multiresistant organisms and nosocomial infections , 1999, AMIA.

[3]  R M Gardner,et al.  Computer surveillance of hospital-acquired infections and antibiotic use. , 1986, JAMA.

[4]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[5]  C L Bartlett,et al.  An evaluation of surveillance methods for detecting infections in hospital inpatients. , 1993, The Journal of hospital infection.

[6]  Requirements for infrastructure and essential activities of infection control and epidemiology in hospitals : A consensus panel report , 1998 .

[7]  M. Dettenkofer,et al.  Comparison of effectiveness and required time of two surveillance methods in intensive care patients. , 1999, The Journal of hospital infection.

[8]  K E Willard,et al.  Radical improvements in the display of clinical microbiology results: a Web-based clinical information system. , 1996, The American journal of medicine.

[9]  J M Hughes,et al.  CDC definitions for nosocomial infections, 1988. , 1988, American journal of infection control.

[10]  P. Legrand,et al.  Diagnosis of central venous catheter-related sepsis. Critical level of quantitative tip cultures. , 1987, Archives of internal medicine.

[11]  R. Haley,et al.  The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. , 1985, American journal of epidemiology.

[12]  M Rapin,et al.  Diagnosis of Central Venous Catheter-Related Sepsis: Critical Level of Quantitative Tip Cultures , 1987 .

[13]  M G Kahn,et al.  An expert system for culture-based infection control surveillance. , 1993, Proceedings. Symposium on Computer Applications in Medical Care.

[14]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[15]  C. Belío-Blasco,et al.  Evaluation of Two Retrospective Active Surveillance Methods for the Detection of Nosocomial Infection in Surgical Patients , 2000, Infection Control & Hospital Epidemiology.

[16]  S. Sheps,et al.  Validation of New Tests , 1991, Infection Control & Hospital Epidemiology.

[17]  B. Yangco,et al.  CDC definitions for nosocomial infections. , 1989, American journal of infection control.