A simple and robust method for multivariate meta‐analysis of diagnostic test accuracy

Meta-analysis of diagnostic test accuracy often involves mixture of case-control and cohort studies. The existing bivariate random-effects models, which jointly model bivariate accuracy indices (e.g., sensitivity and specificity), do not differentiate cohort studies from case-control studies and thus do not utilize the prevalence information contained in the cohort studies. The recently proposed trivariate generalized linear mixed-effects models are only applicable to cohort studies, and more importantly, they assume a common correlation structure across studies and trivariate normality on disease prevalence, test sensitivity, and specificity after transformation by some pre-specified link functions. In practice, very few studies provide justifications of these assumptions, and sometimes these assumptions are violated. In this paper, we evaluate the performance of the commonly used random-effects model under violations of these assumptions and propose a simple and robust method to fully utilize the information contained in case-control and cohort studies. The proposed method avoids making the aforementioned assumptions and can provide valid joint inferences for any functions of overall summary measures of diagnostic accuracy. Through simulation studies, we find that the proposed method is more robust to model misspecifications than the existing methods. We apply the proposed method to a meta-analysis of diagnostic test accuracy for the detection of recurrent ovarian carcinoma. Copyright © 2016 John Wiley & Sons, Ltd.

[1]  Paul-Christian Bürkner,et al.  Testing for publication bias in diagnostic meta‐analysis: a simulation study , 2014, Statistics in medicine.

[2]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[3]  Haitao Chu,et al.  Statistical methods for multivariate meta-analysis of diagnostic tests: An overview and tutorial , 2016, Statistical methods in medical research.

[4]  P. Bossuyt,et al.  Sources of Variation and Bias in Studies of Diagnostic Accuracy , 2004, Annals of Internal Medicine.

[5]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[6]  Stephanie A. Mulherin,et al.  Spectrum Bias or Spectrum Effect? Subgroup Variation in Diagnostic Test Evaluation , 2002, Annals of Internal Medicine.

[7]  L. Joseph,et al.  Bayesian estimation of disease prevalence and the parameters of diagnostic tests in the absence of a gold standard. , 1995, American journal of epidemiology.

[8]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[9]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[10]  S. Walter,et al.  Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data , 2002, Statistics in medicine.

[11]  Gang Huang,et al.  CA 125, PET alone, PET-CT, CT and MRI in diagnosing recurrent ovarian carcinoma: a systematic review and meta-analysis. , 2009, European journal of radiology.

[12]  Haitao Chu,et al.  A unification of models for meta‐analysis of diagnostic accuracy studies without a gold standard , 2015, Biometrics.

[13]  A. Jemal,et al.  Cancer statistics, 2014 , 2014, CA: a cancer journal for clinicians.

[14]  Haitao Chu,et al.  Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models , 2010, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Richard D Riley,et al.  Rejoinder to commentaries on ‘Multivariate meta‐analysis: Potential and promise’ , 2011 .

[16]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[17]  Theo Stijnen,et al.  The binomial distribution of meta-analysis was preferred to model within-study variability. , 2008, Journal of clinical epidemiology.

[18]  Haitao Chu,et al.  Meta‐analysis of diagnostic accuracy studies accounting for disease prevalence: Alternative parameterizations and model selection , 2009, Statistics in medicine.

[19]  J. C. Christiansen,et al.  Determinants of sensitivity and specificity of electrocardiographic criteria for left ventricular hypertrophy. , 1990, Circulation.

[20]  J. Douglas,et al.  Confidence Regions for Parameter Pairs , 1993 .

[21]  Oliver Kuss,et al.  Meta‐analysis for diagnostic accuracy studies: a new statistical model using beta‐binomial distributions and bivariate copulas , 2014, Statistics in medicine.

[22]  J. C. Houwelingen,et al.  Bivariate Random Effects Meta-Analysis of ROC Curves , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.

[24]  A. Megibow,et al.  Accuracy of CT in detection of persistent or recurrent ovarian carcinoma: correlation with second-look laparotomy. , 1988, Radiology.

[25]  A. Feinstein,et al.  Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. , 1978, The New England journal of medicine.

[26]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[27]  Jun Yan,et al.  Modeling Multivariate Distributions with Continuous Margins Using the copula R Package , 2010 .

[28]  T C Randall,et al.  Ten-year follow-up of ovarian cancer patients after second-look laparotomy with negative findings. , 1999, Obstetrics and gynecology.

[29]  Haitao Chu,et al.  Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. , 2006, Journal of clinical epidemiology.

[30]  Roger M Harbord,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2007, Biostatistics.

[31]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[32]  Nandini Dendukuri,et al.  Bayesian Meta‐Analysis of the Accuracy of a Test for Tuberculous Pleuritis in the Absence of a Gold Standard Reference , 2012, Biometrics.

[33]  Johannes B Reitsma,et al.  Evidence of bias and variation in diagnostic accuracy studies , 2006, Canadian Medical Association Journal.

[34]  Mei-Ling Ting Lee,et al.  On Maximum Attainable Correlation and Other Measures of Dependence for the Sarmanov Family of Bivariate Distributions , 2004 .

[35]  Thomas A Louis,et al.  Random Effects Models in a Meta-Analysis of the Accuracy of Two Diagnostic Tests Without a Gold Standard , 2009, Journal of the American Statistical Association.

[36]  Johannes B Reitsma,et al.  Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  So Young Sohn,et al.  Multivariate meta analysis with potentially correlated marketing study results , 2000 .

[38]  Ingram Olkin,et al.  Adjusting for publication bias in the presence of heterogeneity , 2003, Statistics in medicine.

[39]  Mei-Ling Ting Lee,et al.  Properties and applications of the sarmanov family of bivariate distributions , 1996 .

[40]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[41]  Sheng Luo,et al.  Bayesian analysis on meta-analysis of case-control studies accounting for within-study correlation , 2015, Statistical methods in medical research.

[42]  N. Reid,et al.  AN OVERVIEW OF COMPOSITE LIKELIHOOD METHODS , 2011 .

[43]  Jun Yan,et al.  Enjoy the Joy of Copulas: With a Package copula , 2007 .

[44]  Thomas A Trikalinos,et al.  An empirical comparison of univariate and multivariate meta‐analyses for categorical outcomes , 2014, Statistics in medicine.