A sequential design to estimate sensitivity and specificity of a diagnostic or screening test

We consider efficient study designs to estimate sensitivity and specificity of a candidate diagnostic or screening test. Our focus is the setting in which the candidate test is inexpensive to administer compared to evaluation of disease status, and the test results, available in a large cohort, can be used as a basis for sampling subjects for verification of disease status. We examine designs in which disease status is verified in a sample chosen so as to optimize estimation of either sensitivity or specificity. We then propose a sequential design in which the first step of sampling is conducted to efficiently estimate specificity. If the candidate test is determined to be of sufficient specificity, then step two of sampling is conducted to estimate sensitivity. We propose estimators based on this sequential sampling scheme, and show that the performance of these estimators is excellent. We develop sample size calculations for the sequential design, and show that this design, in most situations, compares favourably in terms of expected sample size to a fixed size design.

[1]  Roseanne McNamee,et al.  Optimal designs of two‐stage studies for estimation of sensitivity, specificity and positive predictive value , 2002, Statistics in medicine.

[2]  A two-stage validation study for determining sensitivity and specificity. , 1994, Environmental health perspectives.

[3]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[4]  R A Greenes,et al.  Assessment of diagnostic tests when disease verification is subject to selection bias. , 1983, Biometrics.

[5]  J M Simpson,et al.  Efficient study designs to assess the accuracy of screening tests. , 1994, American journal of epidemiology.

[6]  M. Lederman,et al.  Neurological outcomes in late HIV infection: adverse impact of neurological impairment on survival and protective effect of antiviral therapy. AIDS Clinical Trial Group and Neurological AIDS Research Consortium study team. , 1999, AIDS.

[7]  S. Pocock,et al.  Stopping rules and estimation problems in clinical trials. , 1988, Statistics in medicine.

[8]  John Whitehead,et al.  On the bias of maximum likelihood estimation following a sequential test , 1986 .

[9]  A. Tenenbein.  A Double Sampling Scheme for Estimating from Binomial Data with Misclassifications , 1970 .

[10]  J. Whitehead.  Supplementary analysis at the conclusion of a sequential clinical trial. , 1986, Biometrics.

[11]  J. Kaldor,et al.  Changes to AIDS dementia complex in the era of highly active antiretroviral therapy. , 1999, AIDS.

[12]  Xiao-Hua Zhou,et al.  Maximum likelihood estimators of sensitivity and specificity corrected for verification bias , 1993 .

[13]  Xiao-Hua Zhou,et al.  Prospective studies of diagnostic test accuracy when disease prevalence is low. , 2002, Biostatistics.