Evaluation of a Rapid Test for the Diagnosis of Cholera in the Absence of a Gold Standard

Background Early detection and confirmation of cholera outbreaks are crucial for rapid implementation of control measures. Because cholera frequently affects regions with limited laboratory resources, rapid diagnostic tests (RDT) designed for field conditions are important to enhance rapid response. Stool culture remains the “gold standard” for cholera diagnosis; however, its lack of sensitivity may lead to underestimation of test specificity. We evaluated the Crystal VC® immunochromatographic test (Span Diagnostics, India) for cholera diagnosis using a modified reference standard that combines culture-dependent and independent assays, or a Bayesian latent class model (LCM) analysis. Methodology/Principal Findings The study was conducted during a cholera epidemic in 2008, in Lubumbashi, Democratic Republic of Congo. Stools collected from 296 patients were used to perform the RDT on site and sent to Institut Pasteur, Paris, for bacterial culture. In comparison with culture as the gold standard, the RDT showed good sensitivity (92.2%; 95% CI: 86.8%–95.9%) but poor specificity when used by a trained laboratory technician (70.6%; 95% CI: 60.7%–79.2%) or by clinicians with no specific test training (60.4%, 95% CI: 50.2%–70.0%). The specificity of the test performed by the laboratory technician increased to 88.6% (95% CI: 78.7–94.9) when PCR was combined with culture results as the reference standard, and to 85.0% (95% CI: 70.4–99.2), when the Bayesian LCM analysis was used for performance evaluation. In both cases, the sensitivity remained high. Conclusion Using an improved reference standard or appropriate statistical methods for diagnostic test evaluations in the absence of a gold standard, we report better performance of the Crystal VC® RDT than previously published. Our results confirm that this test can be used for early outbreak detection or epidemiological surveillance, key components of efficient global cholera control. Our analysis also highlights the importance of improving evaluations of RDT when no reliable gold standard is available.

[1]  A. Naheed,et al.  Evaluation of three rapid diagnostic tests for cholera: does the skill level of the technician matter? , 2006, Tropical medicine & international health : TM & IH.

[2]  Taesung Park,et al.  Field evaluation of a rapid immunochromatographic dipstick test for the diagnosis of cholera in a high-risk population , 2006, BMC infectious diseases.

[3]  Y. Takeda,et al.  Evaluation of a rapid immunochromatographic dipstick kit for diagnosis of cholera emphasizes its outbreak utility. , 2010, Japanese journal of infectious diseases.

[4]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[5]  S K Bhattacharya,et al.  Development and evaluation of a multiplex PCR assay for rapid detection of toxigenic Vibrio cholerae O1 and O139. , 1998, FEMS immunology and medical microbiology.

[6]  Marzia Sultana,et al.  Diagnostic Limitations to Accurate Diagnosis of Cholera , 2010, Journal of Clinical Microbiology.

[7]  M. A. Malek,et al.  Use of Dipsticks for Rapid Diagnosis of Cholera Caused by Vibrio cholerae O1 and O139 from Rectal Swabs , 2003, Journal of Clinical Microbiology.

[8]  Nandini Dendukuri,et al.  Bayesian sample size for diagnostic test studies in the absence of a gold standard: Comparing identifiable with non‐identifiable models , 2010, Statistics in medicine.

[9]  Scott Zeger,et al.  Methods for evaluating the performance of diagnostic tests in the absence of a gold standard: a latent class model approach , 2002, Statistics in medicine.

[10]  Walter R. Gilks,et al.  BUGS - Bayesian inference Using Gibbs Sampling Version 0.50 , 1995 .

[11]  I A Gardner,et al.  Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. , 2005, Preventive veterinary medicine.

[12]  Claes Enùea,et al.  Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown , 2000 .

[13]  D. Sack,et al.  One-Step Immunochromatographic Dipstick Tests for Rapid Detection of Vibrio cholerae O1 and O139 in Stool Samples , 2003, Clinical Diagnostic Laboratory Immunology.

[14]  E. Mintz,et al.  Field evaluation of Crystal VC® Rapid Dipstick test for cholera during a cholera outbreak in Guinea‐Bissau , 2009, Tropical medicine & international health : TM & IH.

[15]  A. Steigerwalt,et al.  Escherichia vulneris: a New Species of Enterobacteriaceae Associated with Human Wounds , 1982, Journal of clinical microbiology.

[16]  Claudio J. Verzilli,et al.  Defining the True Sensitivity of Culture for the Diagnosis of Melioidosis Using Bayesian Latent Class Models , 2010, PloS one.

[17]  Cholera, 2010. , 2011, Releve epidemiologique hebdomadaire.