Evaluating accuracy of diagnostic tests with intermediate results in the absence of a gold standard

Intermediate test results often occur with diagnostic tests. When assessing diagnostic accuracy, it is important to properly report and account for these results. In the literature, these results are commonly discarded prior to analysis or treated as either a positive or a negative result. Although such adjustments allow sensitivity and specificity to be computed in the standard way, these forced decisions limit the interpretability and usefulness of the results. Estimation of diagnostic accuracy is further complicated when tests are evaluated without a gold standard. Although traditional latent class modeling can be readily applied to analyze these data and account for intermediate results, these models assume that tests are independent conditional on the true disease status, which is rarely valid in practice. We extend both the log-linear latent class model and the probit latent class model to accommodate the conditional dependence among tests while taking the intermediate results into consideration. We illustrate our methods using a simulation study and a published medical study on the detection of epileptiform activity in the brain.

[1]  William C Miller,et al.  Detection of acute infections during HIV testing in North Carolina. , 2005, The New England journal of medicine.

[2]  J. Hagenaars Latent Structure Models with Direct Effects between Indicators , 1988 .

[3]  A. Genz Numerical Computation of Multivariate Normal Probabilities , 1992 .

[4]  Lilian M. de Menezes On fitting latent class models for binary data: The estimation of standard errors , 1999 .

[5]  L. Goldstein,et al.  HER-2 testing in breast cancer using parallel tissue-based methods. , 2004, JAMA.

[6]  S. Hui,et al.  Evaluation of diagnostic tests without gold standards , 1998, Statistical methods in medical research.

[7]  Huiping Xu,et al.  A Probit Latent Class Model with General Correlation Structures for Evaluating Accuracy of Diagnostic Tests , 2009, Biometrics.

[8]  A. A. Dingle,et al.  Real-time Detection of Epileptiform Activity in the EEG: A Blinded Clinical Trial , 2000, Clinical EEG.

[9]  E. DeLong,et al.  Intermediate, Indeterminate, and Uninterpretable Diagnostic Test Results , 1987, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  P. Albert,et al.  A Cautionary Note on the Robustness of Latent Class Models for Estimating Diagnostic Error without a Gold Standard , 2004, Biometrics.

[11]  M. Tan,et al.  Random effects models in latent class analysis for evaluating accuracy of diagnostic tests. , 1996, Biometrics.

[12]  I. Gaboury,et al.  Evaluation of the QuickLab RSV Test, a New Rapid Lateral-Flow Immunoassay for Detection of Respiratory Syncytial Virus Antigen , 2004, Journal of Clinical Microbiology.

[13]  Joseph G Ibrahim,et al.  On the estimation of disease prevalence by latent class models for screening studies using two screening tests with categorical disease status verified in test positives only , 2010, Statistics in Medicine.

[14]  John S. Uebersax,et al.  Probit Latent Class Analysis with Dichotomous or Ordered Category Measures: Conditional Independence/Dependence Models , 1999 .

[15]  P M Vacek,et al.  The effect of conditional dependence on the evaluation of diagnostic tests. , 1985, Biometrics.

[16]  C. Clogg Latent Class Models , 1995 .

[17]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[18]  M. Espeland,et al.  Using latent class models to characterize and assess relative error in discrete measurements. , 1989, Biometrics.

[19]  Margaret Sullivan Pepe,et al.  Insights into latent class analysis of diagnostic test performance. , 2007, Biostatistics.

[20]  I Yang,et al.  Latent variable modeling of diagnostic accuracy. , 1997, Biometrics.