Estimation of sensitivity and specificity of three conditionally dependent diagnostic tests in the absence of a gold standard

This article presents a model to evaluate the accuracy of diagnostic tests. Data from three tests for the detection of EF-positive Streptococcus suis serotype 2 strains in sows were analyzed. The data were collected in a field study in the absence of a gold standard, that is, the true disease status (noninfected or infected) of the tested animals was unknown. Two tests were based on a polymerase chain reaction (PCR); one test was applied to a tonsil swab (taken from the live animal), and the other test was applied to the whole tonsil (collected at slaughter). The third test was based on a bacterial examination (BE) of the whole tonsil. To reduce experimental cost BE was performed only for a subset of the animals in the sample. The model allows for dependence between tests, conditional upon the unknown true disease status of the animals. Accuracy was expressed in terms of sensitivity and specificity of the tests. A Bayesian analysis was performed that incorporated prior information about the accuracy of the tests. The model parameters have a simple interpretation and specification of priors is straightforward. Posterior inference was carried out with Markov chain Monte Carlo (MCMC) methods, employing the Gibbs sampler, as implemented in the WinBUGS program. Different parameterizations to allow for selection and missing values, use of different priors, practical problems in the analysis, and some interesting issues in a joint analysis of the binary (positive or negative) results of PCR and BE and two additional continuous enzyme-linked immunosorbent assays (ELISA) are discussed.

[1]  David B. Dunson,et al.  Bayesian Data Analysis , 2010 .

[2]  M. Chengappa,et al.  Streptococcus Suis: Past and Present , 1997, Veterinary Research Communications.

[3]  A. Hadgu,et al.  A biomedical application of latent class models with random effects , 2002 .

[4]  L McAlpine,et al.  CAVH. Principles and practical applications. , 1998, Critical care nursing clinics of North America.

[5]  H Stryhn,et al.  Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. , 2000, Preventive veterinary medicine.

[6]  P M Vacek,et al.  The effect of conditional dependence on the evaluation of diagnostic tests. , 1985, Biometrics.

[7]  Yinsheng Qu,et al.  A Model for Evaluating Sensitivity and Specificity for Correlated Diagnostic Tests in Efficacy Studies with an Imperfect Reference Test , 1998 .

[8]  Peter Congdon Bayesian statistical modelling , 2002 .

[9]  M. Greiner,et al.  Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. , 2000, Preventive veterinary medicine.

[10]  S D Walter,et al.  Effects of dependent errors in the assessment of diagnostic test performance. , 1997, Statistics in medicine.

[11]  P. Holland,et al.  Discrete Multivariate Analysis. , 1976 .

[12]  M. D. de Jong,et al.  Evaluation of Diagnostic Tests for the Detection of Classical Swine Fever in the Field without a Gold Standard , 2001, Journal of veterinary diagnostic investigation : official publication of the American Association of Veterinary Laboratory Diagnosticians, Inc.

[13]  M. Nielen,et al.  Detection of extracellular factor-positive Streptococcus suis serotype 2 strains in tonsillar swabs of live sows by PCR. , 2005, Veterinary microbiology.

[14]  Wesley O. Johnson,et al.  Correlation‐adjusted estimation of sensitivity and specificity of two diagnostic tests , 2003 .

[15]  Byron J. T. Morgan,et al.  Deficiency of parameter‐redundant models , 2001 .

[16]  P S Albert,et al.  Latent Class Modeling Approaches for Assessing Diagnostic Error without a Gold Standard: With Applications to p53 Immunohistochemical Assays in Bladder Tumors , 2001, Biometrics.

[17]  Ian A Gardner,et al.  "TAGS", a program for the evaluation of test accuracy in the absence of a gold standard. , 2002, Preventive veterinary medicine.

[18]  D J Spiegelhalter,et al.  Bayesian approaches to random-effects meta-analysis: a comparative study. , 1995, Statistics in medicine.

[19]  Wesley O. Johnson,et al.  Hierarchical models for estimating herd prevalence and test accuracy in the absence of a gold standard , 2003 .

[20]  I Yang,et al.  Latent variable modeling of diagnostic accuracy. , 1997, Biometrics.

[21]  I A Gardner,et al.  Log-linear and logistic modeling of dependence among diagnostic tests. , 2000, Preventive veterinary medicine.

[22]  Els Goetghebeur,et al.  Diagnostic test analyses in search of their gold standard: latent class analyses with random effects , 2000, Statistical methods in medical research.

[23]  J. Hodges,et al.  Posterior bimodality in the balanced one‐way random‐effects model , 2003 .

[24]  P. Albert,et al.  Models for longitudinal data: a generalized estimating equation approach. , 1988, Biometrics.

[25]  David J. Spiegelhalter,et al.  WinBUGS user manual version 1.4 , 2003 .

[26]  L. Joseph,et al.  Bayesian Approaches to Modeling the Conditional Dependence Between Multiple Diagnostic Tests , 2001, Biometrics.

[27]  R J Cook,et al.  Estimation of Operating Characteristics for Dependent Diagnostic Tests Based on Latent Markov Models , 2000, Biometrics.

[28]  J. C. Houwelingen,et al.  Diagnostic Test Evaluation without a Gold Standard , 2005 .

[29]  L. Joseph,et al.  Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. , 1995, American journal of epidemiology.

[30]  M. Tan,et al.  Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. , 1996, Biometrics.

[31]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[32]  H C van Houwelingen,et al.  The (in)validity of sensitivity and specificity. , 2000, Statistics in medicine.

[33]  S. Walter,et al.  Estimating the error rates of diagnostic tests. , 1980, Biometrics.