How to Perform a Systematic Review and Meta-analysis of Diagnostic Imaging Studies.

A systematic review is a comprehensive search, critical evaluation, and synthesis of all the relevant studies on a specific (clinical) topic that can be applied to the evaluation of diagnostic and screening imaging studies. It can be a qualitative or a quantitative (meta-analysis) review of available literature. A meta-analysis uses statistical methods to combine and summarize the results of several studies. In this review, a 12-step approach to performing a systematic review (and meta-analysis) is outlined under the four domains: (1) Problem Formulation and Data Acquisition, (2) Quality Appraisal of Eligible Studies, (3) Statistical Analysis of Quantitative Data, and (4) Clinical Interpretation of the Evidence. This review is specifically geared toward the performance of a systematic review and meta-analysis of diagnostic test accuracy (imaging) studies.

[1]  Haitao Chu,et al.  Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approach. , 2006, Journal of clinical epidemiology.

[2]  Roger M Harbord,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2007, Biostatistics.

[3]  H C Van Houwelingen,et al.  A bivariate approach to meta-analysis. , 1993, Statistics in medicine.

[4]  Richard D Riley,et al.  Beyond the Bench: Hunting Down Fugitive Literature , 2004, Environmental Health Perspectives.

[5]  M. McInnes,et al.  Focal Nodular Hyperplasia and Hepatocellular Adenoma: Accuracy of Gadoxetic Acid-enhanced MR Imaging-A Systematic Review. , 2015, Radiology.

[6]  Steff Lewis,et al.  Forest plots: trying to see the wood and the trees , 2001, BMJ : British Medical Journal.

[7]  R. Simes.  Publication bias: the case for an international registry of clinical trials. , 1986, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[8]  J. Sterne,et al.  Funnel plots for detecting bias in meta-analysis: guidelines on choice of axis. , 2001, Journal of clinical epidemiology.

[9]  J. Deeks,et al.  A methodological review of how heterogeneity has been examined in systematic reviews of diagnostic test accuracy. , 2005, Health technology assessment.

[10]  N. Dendukuri,et al.  Statistics for quantifying heterogeneity in univariate and bivariate meta‐analyses of binary data: The case of meta‐analyses of diagnostic accuracy , 2014, Statistics in medicine.

[11]  Jonathan J Deeks,et al.  The performance of tests of publication bias and other sample size effects in systematic reviews of diagnostic test accuracy was assessed. , 2005, Journal of clinical epidemiology.

[12]  Javier Zamora,et al.  Meta-DiSc : a software for meta-analysis of test accuracy data , 2015 .

[13]  Peter C Gøtzsche,et al.  Data extraction errors in meta-analyses that use standardized mean differences. , 2007, JAMA.

[14]  D. A. Korevaar,et al.  Meta-Analyses of Diagnostic Accuracy in Imaging Journals: Analysis of Pooling Techniques and Their Effect on Summary Estimates of Diagnostic Accuracy. , 2016, Radiology.

[15]  Jonathan A C Sterne,et al.  Systematic reviews in health care: Investigating and dealing with publication and other biases in meta-analysis. , 2001, BMJ.

[16]  Petra Macaskill,et al.  Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. , 2004, Journal of clinical epidemiology.

[17]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.

[18]  Nikolaos A Patsopoulos,et al.  Uncertainty in heterogeneity estimates in meta-analyses , 2007, BMJ : British Medical Journal.

[19]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[21]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[22]  S. Rabe-Hesketh,et al.  Reliable Estimation of Generalized Linear Mixed Models using Adaptive Quadrature , 2002 .

[23]  Christopher H Schmid,et al.  In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. , 2005, Journal of clinical epidemiology.

[24]  Jialiang Li,et al.  Prevalence‐dependent diagnostic accuracy measures , 2007, Statistics in medicine.

[25]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[26]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[27]  I. Olkin,et al.  The case of the misleading funnel plot , 2006, BMJ : British Medical Journal.

[28]  D. A. Korevaar,et al.  Treatment of multiple test readers in diagnostic accuracy systematic reviews-meta-analyses of imaging studies. , 2017, European journal of radiology.

[29]  Fagan Tj.  Letter: Nomogram for Bayes theorem. , 1975 .

[30]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[31]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[32]  P. Bossuyt,et al.  Sources of Variation and Bias in Studies of Diagnostic Accuracy , 2004, Annals of Internal Medicine.

[33]  J. Hanley.  Receiver operating characteristic (ROC) methodology: the state of the art. , 1989, Critical reviews in diagnostic imaging.

[34]  George Davey Smith,et al.  Misleading meta-analysis , 1995, BMJ.

[35]  Lisa Hartling,et al.  Single data extraction generated more errors than double data extraction in systematic reviews. , 2006, Journal of clinical epidemiology.

[36]  D. Cook,et al.  Methodologic guidelines for systematic reviews of randomized control trials in health care from the Potsdam Consultation on Meta-Analysis. , 1995, Journal of clinical epidemiology.

[37]  Sang Hyun Choi,et al.  Systematic Review and Meta-Analysis of Studies Evaluating Diagnostic Test Accuracy: A Practical Review for Clinical Researchers-Part II. Statistical Methods of Meta-Analysis , 2015, Korean journal of radiology.

[38]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[39]  J. Sehouli,et al.  Original Paper: A likelihood ratio approach to meta-analysis of diagnostic studies , 2003 .

[40]  P C Lambert,et al.  An evaluation of bivariate random‐effects meta‐analysis for the joint synthesis of two correlated outcomes , 2007, Statistics in medicine.

[41]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[42]  C. Tudor-Smith,et al.  Healthy eating in Wales , 1995, BMJ.

[43]  Paula R Williamson,et al.  High prevalence but low impact of data extraction and reporting errors were found in Cochrane systematic reviews. , 2005, Journal of clinical epidemiology.

[44]  C. Mulrow,et al.  Systematic Reviews: Rationale for systematic reviews , 1994, BMJ.

[45]  Patrick M M Bossuyt,et al.  Exploring sources of heterogeneity in systematic reviews of diagnostic tests , 2002, Statistics in medicine.

[46]  Ben A. Dwamena,et al.  MIDAS: Stata module for meta-analytical integration of diagnostic test accuracy studies , 2007 .

[47]  S. Thompson,et al.  Quantifying heterogeneity in a meta‐analysis , 2002, Statistics in medicine.

[48]  B Littenberg,et al.  A Meta-analytic Method for Summarizing Diagnostic Test Performances , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[49]  P. Bossuyt,et al.  Development and validation of methods for assessing the quality of diagnostic accuracy studies. , 2004, Health technology assessment.

[50]  A. Sutton,et al.  Comparison of two methods to detect publication bias in meta-analysis. , 2006, JAMA.

[51]  J. C. Houwelingen,et al.  Bivariate Random Effects Meta-Analysis of ROC Curves , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[52]  Robert A Parker,et al.  BMC Medical Research Methodology BioMed Central BMC 22002, Medical Research Methodology , 2001 .

[53]  P. Bossuyt,et al.  BMC Medical Research Methodology , 2002 .