An Integrated Bayesian Nonparametric Approach for Stochastic and Variability Orders in ROC Curve Estimation: An Application to Endometriosis Diagnosis

In estimating ROC curves of multiple tests, some a priori constraints may exist, either between the healthy and diseased populations within a test or between tests within a population. In this article, we proposed an integrated modeling approach for ROC curves that jointly accounts for stochastic and variability orders. The stochastic order constrains the distributional centers of the diseased and healthy populations within a test, while the variability order constrains the distributional spreads of the tests within each of the populations. Under a Bayesian nonparametric framework, we used features of the Dirichlet process mixture to incorporate these order constraints in a natural way. We applied the proposed approach to data from the Physician Reliability Study that investigated the accuracy of diagnosing endometriosis using different clinical information. To address the issue of no gold standard in the real data, we used a sensitivity analysis approach that exploited diagnosis from a panel of experts. To demonstrate the performance of the methodology, we conducted simulation studies with varying sample sizes, distributional assumptions, and order constraints. Supplementary materials for this article are available online.

[1]  Wesley O Johnson,et al.  Bayesian estimation of the receiver operating characteristic curve for a diagnostic test with a limit of detection in the absence of a gold standard , 2010, Statistics in medicine.

[2]  A. Branscum,et al.  Multivariate mixtures of Polya trees for modeling ROC data , 2008 .

[3]  Abel Rodríguez,et al.  Bayesian semiparametric estimation of covariate-dependent ROC curves. , 2014, Biostatistics.

[4]  W. Gilks Markov Chain Monte Carlo , 2005 .

[5]  F. T. Wright,et al.  Order restricted statistical inference , 1988 .

[6]  Alan E. Gelfand,et al.  Modeling Variability Order: A Semiparametric Bayesian Approach , 2001 .

[7]  T. Ferguson A Bayesian Analysis of Some Nonparametric Problems , 1973 .

[8]  G. Casella,et al.  Explaining the Gibbs Sampler , 1992 .

[9]  Abel Rodr Bayesian semiparametric estimation of covariate-dependent ROC curves , 2013 .

[10]  Bo Zhang,et al.  Interrater and Intrarater Reliability in the Diagnosis and Staging of Endometriosis , 2012, Obstetrics and gynecology.

[11]  S. Ghosal,et al.  Bayesian bootstrap estimation of ROC curve , 2008, Statistics in medicine.

[12]  B. Turnbull,et al.  NONPARAMETRIC AND SEMIPARAMETRIC ESTIMATION OF THE RECEIVER OPERATING CHARACTERISTIC CURVE , 1996 .

[13]  T. Cai,et al.  Semi-parametric estimation of the binormal ROC curve for a continuous diagnostic test. , 2004, Biostatistics.

[14]  Alaattin Erkanli,et al.  Bayesian semi‐parametric ROC analysis , 2006, Statistics in medicine.

[15]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[16]  Chris Lloyd,et al.  Using Smoothed Receiver Operating Characteristic Curves to Summarize and Compare Diagnostic Systems , 1998 .

[17]  I A Gardner,et al.  Estimation of diagnostic-test sensitivity and specificity through Bayesian modeling. , 2005, Preventive veterinary medicine.

[18]  B. Reiser,et al.  Estimation of the area under the ROC curve , 2002, Statistics in medicine.

[19]  S. Chib,et al.  Understanding the Metropolis-Hastings Algorithm , 1995 .

[20]  C. Antoniak Mixtures of Dirichlet Processes with Applications to Bayesian Nonparametric Problems , 1974 .

[21]  Wesley O Johnson,et al.  Bayesian semiparametric ROC curve estimation and disease diagnosis , 2008, Statistics in medicine.

[22]  J. Rosenthal,et al.  Markov Chain Monte Carlo , 2018 .

[23]  Athanasios Kottas,et al.  Modelling stochastic order in the analysis of receiver operating characteristic data: Bayesian non‐parametric approaches , 2008 .

[24]  Subhashis Ghosal,et al.  Bayesian ROC curve estimation under binormality using a partial likelihood based on ranks , 2007 .

[25]  H. Ishwaran,et al.  Markov chain Monte Carlo in approximate Dirichlet and beta two-parameter process hierarchical models , 2000 .

[26]  Miguel de Carvalho,et al.  Bayesian nonparametric ROC regression modeling , 2013 .

[27]  Alan E. Gelfand,et al.  Nonparametric Bayesian Modeling for Stochastic Order , 2001 .

[28]  Zhuang Miao,et al.  Nonparametric ROC summary statistics for correlated diagnostic marker data , 2012, Statistics in medicine.

[29]  David B Dunson,et al.  Bayesian Estimation of Survival Functions under Stochastic Precedence , 2004, Lifetime data analysis.

[30]  Margaret Sullivan Pepe,et al.  Distribution-free ROC analysis using binary regression techniques. , 2002, Biostatistics.

[31]  D. Bamber The area above the ordinal dominance graph and the area below the receiver operating characteristic graph , 1975 .

[32]  Wesley O Johnson,et al.  Sample size calculations for ROC studies: parametric robustness and Bayesian nonparametrics. , 2012, Statistics in medicine.

[33]  Fengchun Peng,et al.  Bayesian Analysis of ROC Curves Using Markov-chain Monte Carlo Methods , 1996, Medical decision making : an international journal of the Society for Medical Decision Making.

[34]  Albert Sorribas,et al.  A new parametric method based on S‐distributions for computing receiver operating characteristic curves for continuous diagnostic tests , 2002, Statistics in medicine.

[35]  M S Pepe,et al.  Three approaches to regression analysis of receiver operating characteristic curves for continuous test results. , 1998, Biometrics.

[36]  J. Sethuraman A CONSTRUCTIVE DEFINITION OF DIRICHLET PRIORS , 1991 .

[37]  Paul S Albert,et al.  Estimating Diagnostic Accuracy of Raters Without a Gold Standard by Exploiting a Group of Experts , 2012, Biometrics.

[38]  J A Hanley,et al.  The use of the 'binormal' model for parametric ROC analysis of quantitative diagnostic tests. , 1996, Statistics in medicine.

[39]  Peter D. Hoff,et al.  Bayesian methods for partial stochastic orderings , 2003 .

[40]  D. Dunson,et al.  Bayesian nonparametric inference on stochastic ordering. , 2008, Biometrika.

[41]  Liang Peng,et al.  Local linear smoothing of receiver operating characteristic (ROC) curves , 2004 .

[42]  M. Pepe An Interpretation for the ROC Curve and Inference Using GLM Procedures , 2000, Biometrics.

[43]  Subhashis Ghosal,et al.  Bayesian ROC curve estimation under binormality using a rank likelihood , 2009 .