Network meta-analysis of diagnostic test accuracy studies identifies and ranks the optimal diagnostic tests and thresholds for health care policy and decision-making.

OBJECTIVES Network meta-analyses (NMA) have extensively been used to compare the effectiveness of multiple interventions for health care policy and decision-making. However, methods for evaluating the performance of multiple diagnostic tests are less established. In a decision-making context, we are often interested in comparing and ranking the performance of multiple diagnostic tests, at varying levels of test thresholds, in one simultaneous analysis. STUDY DESIGN AND SETTING Motivated by an example of cognitive impairment diagnosis following stroke, we synthesized data from 13 studies assessing the efficiency of two diagnostic tests: Mini-Mental State Examination (MMSE) and Montreal Cognitive Assessment (MoCA), at two test thresholds: MMSE <25/30 and <27/30, and MoCA <22/30 and <26/30. Using Markov chain Monte Carlo (MCMC) methods, we fitted a bivariate network meta-analysis model incorporating constraints on increasing test threshold, and accounting for the correlations between multiple test accuracy measures from the same study. RESULTS We developed and successfully fitted a model comparing multiple tests/threshold combinations while imposing threshold constraints. Using this model, we found that MoCA at threshold <26/30 appeared to have the best true positive rate, whereas MMSE at threshold <25/30 appeared to have the best true negative rate. CONCLUSION The combined analysis of multiple tests at multiple thresholds allowed for more rigorous comparisons between competing diagnostics tests for decision making.

[1]  Oliver Kuss,et al.  Meta‐analysis of full ROC curves using bivariate time‐to‐event models for interval‐censored data , 2018, Research synthesis methods.

[2]  Mir Said Siadaty,et al.  Repeated-measures modeling improved comparison of diagnostic tests in meta-analysis of dependent studies. , 2004, Journal of clinical epidemiology.

[3]  Oliver Kuss,et al.  Meta-analysis for the comparison of two diagnostic tests to a common gold standard: A generalized linear mixed model approach , 2018, Statistical methods in medical research.

[4]  Nishant K Mishra,et al.  Test Accuracy of Informant-Based Cognitive Screening Tests for Diagnosis of Dementia and Multidomain Cognitive Impairment in Stroke , 2016, Stroke.

[5]  H Putter,et al.  Meta‐Analysis of Diagnostic Test Accuracy Studies with Multiple Thresholds using Survival Methods , 2009, Biometrical journal. Biometrische Zeitschrift.

[6]  C Gatsonis,et al.  Meta‐analysis of Diagnostic Test Accuracy Assessment Studies with Varying Number of Thresholds , 2003, Biometrics.

[7]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[9]  Marc Aerts,et al.  ANOVA model for network meta-analysis of diagnostic test accuracy data , 2016, Statistical methods in medical research.

[10]  Gerta Rücker,et al.  Modelling multiple thresholds in meta-analysis of diagnostic test accuracy studies , 2016, BMC Medical Research Methodology.

[11]  Nicola J Cooper,et al.  Integration of Meta-analysis and Economic Decision Modeling for Evaluating Diagnostic Tests , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[12]  Nicola J Cooper,et al.  Evaluating the cost-effectiveness of diagnostic tests in combination: is it important to allow for performance dependency? , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[13]  Maria Adam,et al.  A multivariate method for meta‐analysis and comparison of diagnostic tests , 2016, Statistics in medicine.

[14]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[15]  Marc Aerts,et al.  Beta-binomial analysis of variance model for network meta-analysis of diagnostic test accuracy data , 2018, Statistical methods in medical research.

[16]  Rhiannon K Owen,et al.  Network meta-analysis: development of a three-level hierarchical modeling approach incorporating dose-related constraints. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[17]  Gerta Rücker,et al.  A novel statistical model for analyzing data of a systematic review generates optimal cutoff values for fractional exhaled nitric oxide for asthma diagnosis. , 2017, Journal of clinical epidemiology.

[18]  Jennifer K. Harrison,et al.  Cognitive and Mood Assessment in Stroke Research: Focused Review of Contemporary Studies , 2012, Stroke.

[19]  Theo Stijnen,et al.  Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds , 2009, BMC medical research methodology.

[20]  Wei Cheng,et al.  Network Meta-Analysis of Diagnostic Accuracy Studies , 2015 .

[21]  N. Choudhry,et al.  The conditional relative odds ratio provided less biased results for comparing diagnostic test accuracy in meta-analyses. , 2004, Journal of clinical epidemiology.

[22]  Peter Langhorne,et al.  Test Accuracy of Cognitive Screening Tests for Diagnosis of Dementia and Multidomain Cognitive Impairment in Stroke , 2014, Stroke.

[23]  Nicola J Cooper,et al.  Meta-analysis of the accuracy of two diagnostic tests used in combination: application to the ddimer test and the wells score for the diagnosis of deep vein thrombosis. , 2013, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[24]  Emmanuel Lesaffre,et al.  A general framework for comparative Bayesian meta-analysis of diagnostic studies , 2015, BMC Medical Research Methodology.

[25]  Thomas A Trikalinos,et al.  Methods for the joint meta‐analysis of multiple tests , 2013, Research synthesis methods.

[26]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.

[27]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[28]  Richard D Riley,et al.  Meta-analysis of test accuracy studies with multiple and missing thresholds : a multivariate-normal model , 2014 .

[29]  Douglas G. Altman,et al.  Effect Measures for Meta‒Analysis of Trials with Binary Outcomes , 2008 .

[30]  Haitao Chu,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2009, Biostatistics.