Nonparametric analysis for the ROC areas of two diagnostic tests in the presence of nonignorable verification bias

Abstract A paired design is often used to evaluate the accuracies of competing diagnostic tests. One common problem in a paired design is verification bias which occurs when some patients do not receive disease verification and when the reason for verification depends on the test results and other factors. Most of the existing methods for verification bias correction assume the verification process is ignorable, which means that the probability of verifying a patient depends only on the observed covariates, but not on the unobserved disease status of the patient. In this paper, we develop a bias correction procedure without assuming ignorability of the verification mechanism. As far as we know, this proposed method is the first attempt to combine nonignorable verification with estimation of the ROC areas. At issue is the possible existence of multiple local maxima and boundary solutions for the maximum likelihood (ML) equations, which can complicate the computation of the ML estimates. To deal with this computational difficulty, we propose a profile method combined with the EM algorithm to find the global ML estimators for the parameters of interest under a proposed nonignorable verification model. Furthermore, we also find a simple solution to the boundary point problem. After obtaining the ML estimates, we propose likelihood-based inferences on the relative accuracy of two diagnostic tests. Another issue in the analysis is the goodness-of-fit of the proposed nonignorable model for the verification mechanism. We propose to use a bootstrap-based goodness-of-fit test for the proposed nonignorable model. Finally, we apply our method to data from a real study that has motivated this research. In this example, the aim of our analysis is to compare the relative accuracy of MRI and CT imaging in detecting advanced stage pancreatic cancer.

[1]  S G Baker,et al.  Evaluating multiple diagnostic tests with partial verification. , 1995, Biometrics.

[2]  X H Zhou,et al.  Comparing correlated areas under the ROC curves of two diagnostic tests in the presence of verification bias. , 1998, Biometrics.

[3]  P. Greenwood,et al.  A Guide to Chi-Squared Testing , 1996 .

[4]  A. Agresti,et al.  Categorical Data Analysis , 1991, International Encyclopedia of Statistical Science.

[5]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[6]  Xiao-Hua Zhou,et al.  Maximum likelihood estimators of sensitivity and specificity corrected for verification bias , 1993 .

[7]  J G Ibrahim,et al.  Parameter estimation from incomplete data in binomial regression when the missing data mechanism is nonignorable. , 1996, Biometrics.

[8]  Roderick J. A. Little,et al.  Statistical Analysis with Missing Data , 1988 .

[9]  R. Little Pattern-Mixture Models for Multivariate Incomplete Data , 1993 .

[10]  Xiao-Hua Zhou,et al.  Estimating an roc curve in the presence of non-ignorable verification bias , 1998 .

[11]  X H Zhou,et al.  Effect of verification bias on positive and negative predictive values. , 1994, Statistics in medicine.

[12]  Taesung Park,et al.  Models for Categorical Data with Nonignorable Nonresponse , 1994 .

[13]  Roderick J. A. Little,et al.  Modeling the Drop-Out Mechanism in Repeated-Measures Studies , 1995 .

[14]  C B Begg,et al.  Biases in the assessment of diagnostic tests. , 1987, Statistics in medicine.

[15]  Nan M. Laird,et al.  Regression Analysis for Categorical Variables with Outcome Subject to Nonignorable Nonresponse , 1988 .

[16]  A. Aisen,et al.  Pancreatic adenocarcinoma: CT versus MR imaging in the evaluation of resectability--report of the Radiology Diagnostic Oncology Group. , 1995, Radiology.