Fully non-parametric receiver operating characteristic curve estimation for random-effects meta-analysis

Meta-analyses, broadly defined as the quantitative review and synthesis of the results of related but independent comparable studies, allow to know the state of the art of one considered topic. Since the amount of available bibliography has enhanced in almost all fields and, specifically, in biomedical research, its popularity has drastically increased during the last decades. In particular, different methodologies have been developed in order to perform meta-analytic studies of diagnostic tests for both fixed- and random-effects models. From a parametric point of view, these techniques often compute a bivariate estimation for the sensitivity and the specificity by using only one threshold per included study. Frequently, an overall receiver operating characteristic curve based on a bivariate normal distribution is also provided. In this work, the author deals with the problem of estimating an overall receiver operating characteristic curve from a fully non-parametric approach when the data come from a meta-analysis study i.e. only certain information about the diagnostic capacity is available. Both fixed- and random-effects models are considered. In addition, the proposed methodology lets to use the information of all cut-off points available (not only one of them) in the selected original studies. The performance of the method is explored through Monte Carlo simulations. The observed results suggest that the proposed estimator is better than the reference one when the reported information is related to a threshold based on the Youden index and when information for two or more points are provided. Real data illustrations are included.

[1]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[2]  Mark Petticrew,et al.  Systematic reviews from astronomy to zoology: myths and misconceptions , 2001, BMJ : British Medical Journal.

[3]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[4]  P. Martínez-Camblor,et al.  A general bootstrap algorithm for hypothesis testing , 2012 .

[5]  Johannes B Reitsma,et al.  Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[6]  M. Falagas,et al.  Serum procalcitonin as a diagnostic marker for neonatal sepsis: a systematic review and meta-analysis , 2011, Intensive Care Medicine.

[7]  J. Ioannidis,et al.  Relative Citation Impact of Various Study Designs in the Health Sciences , 2005, JAMA.

[8]  W. Müller,et al.  Procalcitonin and interleukin‐6 in the diagnosis of early‐onset sepsis of the neonate , 2003, Acta paediatrica.

[9]  Haitao Chu,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2009, Biostatistics.

[10]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[11]  Richard D Riley,et al.  An alternative model for bivariate random-effects meta-analysis when the within-study correlations are unknown. , 2008, Biostatistics.

[12]  N. Boo,et al.  Usefulness of a semi-quantitative procalcitonin test kit for early diagnosis of neonatal sepsis. , 2008, Singapore medical journal.

[13]  J Menke,et al.  Bivariate Random-effects Meta-analysis of Sensitivity and Specificity with SAS PROC GLIMMIX , 2009, Methods of Information in Medicine.

[14]  B Littenberg,et al.  A Meta-analytic Method for Summarizing Diagnostic Test Performances , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[16]  L. Simpson Report on Certain Enteric Fever Inoculation Statistics , 1904, British medical journal.

[17]  Theo Stijnen,et al.  Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds , 2009, BMC medical research methodology.

[18]  Alireza Abdollahi,et al.  Diagnostic Value of Simultaneous Measurement of Procalcitonin, Interleukin-6 and hs-CRP in Prediction of Early-Onset Neonatal Sepsis , 2012, Mediterranean journal of hematology and infectious diseases.

[19]  Carlos Carleos,et al.  General nonparametric ROC curve comparison , 2013 .

[20]  Jonathan J Deeks,et al.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. , 2001, BMJ.

[21]  S L Normand,et al.  Meta-analysis: formulating, evaluating, combining, and reporting. , 1999, Statistics in medicine.

[22]  B. Turnbull,et al.  NONPARAMETRIC AND SEMIPARAMETRIC ESTIMATION OF THE RECEIVER OPERATING CHARACTERISTIC CURVE , 1996 .

[23]  N. Laird,et al.  Meta-analysis in clinical trials. , 1986, Controlled clinical trials.

[24]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[25]  Julian P T Higgins,et al.  Recent developments in meta‐analysis , 2008, Statistics in medicine.

[26]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[27]  Raghu Kacker,et al.  Random-effects model for meta-analysis of clinical trials: an update. , 2007, Contemporary clinical trials.

[28]  Pablo Martínez-Camblor,et al.  Area under the ROC curve comparison in the presence of missing data , 2013 .

[29]  P. Martínez-Camblor,et al.  Powerful nonparametric statistics to compare k independent ROC curves , 2011 .

[30]  B. Puppala,et al.  Procalcitonin as a Screening Test for Late-Onset Sepsis in Preterm Very Low Birth Weight Infants , 2005, Journal of Perinatology.