A mixed model approach to meta-analysis of diagnostic studies with binary test outcome.

We propose 2 related models for the meta-analysis of diagnostic tests. Both models are based on the bivariate normal distribution for transformed sensitivities and false-positive rates. Instead of using the logit as a transformation for these proportions, we employ the tα family of transformations that contains the log, logit, and (approximately) the complementary log. A likelihood ratio test for the cutoff value problem is developed, and summary receiver operating characteristic (SROC) curves are discussed. Worked examples showcase the methodology. We compare the models to the hierarchical SROC model, which in contrast employs a logit transformation. Data from various meta-analyses are reanalyzed, and the reanalysis indicates a better performance of the models based on the tα transformation.

[1]  Su Xudong,et al.  Summary receiver operating characteristic cure (SROC) for HbA1c. , 2014 .

[2]  G. Sivyer,et al.  Letter to the Editor , 2014, Dermatology practical & conceptual.

[3]  Martyn Plummer,et al.  The R Journal , 2012 .

[4]  Heinz Holling,et al.  Likelihood-Based Clustering of Meta-Analytic SROC Curves , 2012 .

[5]  Shalabh.  Fundamentals of Probability: a First Course , 2011 .

[6]  C. Grilo,et al.  Diagnostic efficiency of DSM-IV indicators for binge eating episodes. , 2011, Journal of consulting and clinical psychology.

[7]  Ryan J. Kettler,et al.  A Brief Broadband System for Screening Children at Risk for Academic Difficulties and Poor Achievement Test Performance: Validity Evidence and Applications to Practice , 2010 .

[8]  G. A. Miller,et al.  Screening for depressive disorders using the Mood and Anxiety Symptoms Questionnaire Anhedonic Depression Scale: a receiver-operating characteristic analysis. , 2010, Psychological assessment.

[9]  Haitao Chu,et al.  Bivariate Random Effects Meta-Analysis of Diagnostic Studies Using Generalized Linear Mixed Models , 2010 .

[10]  M. Pittler.  Systematic Reviews in Health Care: Meta‐analysis in Context , 2010 .

[11]  D. Lehr,et al.  Where is (im)balance? Necessity and construction of evaluated cut‐off points for effort‐reward imbalance and overcommitment , 2010 .

[12]  Stefan Wilhelm,et al.  tmvtnorm: A Package for the Truncated Multivariate Normal Distribution , 2010, R J..

[13]  Theo Stijnen,et al.  Multivariate random effects meta-analysis of diagnostic tests with multiple thresholds , 2009, BMC medical research methodology.

[14]  A. Mitchell,et al.  A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. , 2009, Journal of psychiatric research.

[15]  Haitao Chu,et al.  A unification of models for meta-analysis of diagnostic accuracy studies. , 2009, Biostatistics.

[16]  Levente Kriston,et al.  Meta-analysis: Are 3 Questions Enough to Detect Unhealthy Alcohol Use? , 2008, Annals of Internal Medicine.

[17]  Patrick Bossuyt,et al.  Systematic Reviews of Diagnostic Test Accuracy , 2008, Annals of Internal Medicine.

[18]  C. Crainiceanu,et al.  Restricted Likelihood Ratio Testing for Zero Variance Components in Linear Mixed Models , 2008 .

[19]  J. C. Houwelingen,et al.  Bivariate Random Effects Meta-Analysis of ROC Curves , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[20]  Johannes B Reitsma,et al.  Meta-Analysis of Diagnostic Studies: A Comparison of Random Intercept, Normal-Normal, and Binomial-Normal Bivariate Summary ROC Approaches , 2008, Medical decision making : an international journal of the Society for Medical Decision Making.

[21]  Heinz Holling,et al.  Revisiting youden's index as a useful measure of the misclassification error in meta-analysis of diagnostic studies , 2008, Statistical methods in medical research.

[22]  Chap T Le,et al.  A solution for the most basic optimization problem associated with an ROC curve , 2006, Statistical methods in medical research.

[23]  C. Gatsonis,et al.  Meta-analysis of diagnostic and screening test accuracy evaluations: methodologic primer. , 2006, AJR. American journal of roentgenology.

[24]  J. Nelder,et al.  Generalized Linear Models with Random Effects: Unified Analysis via H-likelihood , 2006 .

[25]  Keith E. Muller,et al.  Extending the Box–Cox transformation to the linear mixed model , 2006 .

[26]  J. Stillman,et al.  A detection theory approach to the evaluation of assessors in assessment centres , 2005 .

[27]  Johannes B Reitsma,et al.  Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviews. , 2005, Journal of clinical epidemiology.

[28]  Thanos Athanasiou,et al.  Summary receiver operating characteristic curve analysis techniques in the evaluation of diagnostic tests. , 2005, The Annals of thoracic surgery.

[29]  Petra Macaskill,et al.  Empirical Bayes estimates generated in a hierarchical summary ROC analysis agreed closely with those of a full Bayesian analysis. , 2004, Journal of clinical epidemiology.

[30]  C. Anderson‐Cook,et al.  An Introduction to Multivariate Statistical Analysis (3rd ed.) (Book) , 2004 .

[31]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[32]  Heinz Holling,et al.  Meta-analysis : new developments and applications in medical and social sciences , 2003 .

[33]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[34]  S. Walter,et al.  Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data , 2002, Statistics in medicine.

[35]  Theo Stijnen,et al.  Advanced methods in meta‐analysis: multivariate approach and meta‐regression , 2002, Statistics in medicine.

[36]  Douglas G. Altman,et al.  Systematic Reviews in Health Care: Meta-Analysis in Context: Second Edition , 2008 .

[37]  C M Rutter,et al.  A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations , 2001, Statistics in medicine.

[38]  Alex J. Sutton,et al.  Methods for Meta-Analysis in Medical Research , 2000 .

[39]  J Carpenter,et al.  Bootstrap confidence intervals: when, which, what? A practical guide for medical statisticians. , 2000, Statistics in medicine.

[40]  Margaret S. Pepe,et al.  Receiver Operating Characteristic Methodology , 2000 .

[41]  B. Lebowitz,et al.  Norms for the Mini-Mental State Examination in a healthy population , 1999, Neurology.

[42]  D. Cornell,et al.  Anger as a predictor of aggression among incarcerated adolescents. , 1999, Journal of consulting and clinical psychology.

[43]  Gordon K. Smyth,et al.  A Conditional Likelihood Approach to Residual Maximum Likelihood Estimation in Generalized Linear Models , 1996 .

[44]  C S Berkey,et al.  A random-effects regression model for meta-analysis. , 1995, Statistics in medicine.

[45]  L. Hedges,et al.  Meta-analysis of screening and diagnostic tests. , 1995, Psychological bulletin.

[46]  Diane C. Thompson,et al.  The validity of self-reported smoking: a review and meta-analysis. , 1994, American journal of public health.

[47]  L E Moses,et al.  Estimating Diagnostic Accuracy from Multiple Conflicting Reports , 1993, Medical decision making : an international journal of the Society for Medical Decision Making.

[48]  L E Moses,et al.  Combining independent studies of a diagnostic test into a summary ROC curve: data-analytic approaches and some additional considerations. , 1993, Statistics in medicine.

[49]  M. Folstein,et al.  Population-based norms for the Mini-Mental State Examination by age and educational level. , 1993, JAMA.

[50]  W F Velicer,et al.  Assessing outcome in smoking cessation studies. , 1992, Psychological bulletin.

[51]  J. Samet.  Health benefits of smoking cessation. , 1991, Clinics in chest medicine.

[52]  C. Perry,et al.  The validity of smoking self-reports by adolescents: a reexamination of the bogus pipeline procedure. , 1987, Addictive behaviors.

[53]  Víctor M. Guerrero,et al.  Use of the Box-Cox transformation with binary response models , 1982 .

[54]  P. Bickel,et al.  An Analysis of Transformations Revisited , 1981 .

[55]  S. Folstein,et al.  "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. , 1975, Journal of psychiatric research.

[56]  P. Lachenbruch.  Mathematical Statistics, 2nd Edition , 1972 .

[57]  J. Gart,et al.  On the bias of various estimators of the logit and its variance with application to quantal bioassay. , 1967, Biometrika.

[58]  D. Cox,et al.  An Analysis of Transformations , 1964 .

[59]  T. W. Anderson,et al.  An Introduction to Multivariate Statistical Analysis , 1959 .

[60]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[61]  E. L. Lehmann,et al.  Theory of point estimation , 1950 .