A CD-based mapping method for combining multiple related parameters from heterogeneous intervention trials.

Effect size can differ as a function of the elapsed time since treatment or as a function of other key covariates, such as sex or age. In evidence synthesis, a better understanding of the precise conditions under which treatment does work or does not work well has been highly valued. With increasingly accessible individual patient or participant data (IPD), more precise and informative inference can be within our reach. However, simultaneously combining multiple related parameters across heterogeneous studies is challenging because each parameter from each study has a specific interpretation within the context of the study and other covariates in the model. This paper proposes a novel mapping method to combine study-specific estimates of multiple related parameters across heterogeneous studies, which ensures valid inference at all inference levels by combining sample-dependent functions known as Confidence Distributions (CD). We describe the "CD-based mapping method" and provide a data application example for a multivariate random-effects meta-analysis model. We estimated up to 13 study-specific regression parameters for each of 14 individual studies using IPD in the first step, and subsequently combined the study-specific vectors of parameters, yielding a full vector of hyperparameters in the second step of meta-analysis. Sensitivity analysis indicated that the CD-based mapping method is robust to model misspecification. This novel approach to multi-parameter synthesis provides a reasonable methodological solution when combining complex evidence using IPD.

[1]  Juned Siddique,et al.  Limitations in Using Multiple Imputation to Harmonize Individual Participant Data for Meta-Analysis , 2018, Prevention Science.

[2]  Eun-Young Mun,et al.  Using mixture models with known class membership to address incomplete covariance structures in multiple-group growth models. , 2014, The British journal of mathematical and statistical psychology.

[3]  Andrea M Hussong,et al.  Integrative data analysis: the simultaneous analysis of multiple data sets. , 2009, Psychological methods.

[4]  Jimmy de la Torre,et al.  Multivariate Higher-Order IRT Model and MCMC Algorithm for Linking Individual Participant Data From Multiple Studies , 2019, Front. Psychol..

[5]  Daniel J Bauer,et al.  Integrative data analysis in clinical psychology research. , 2013, Annual review of clinical psychology.

[6]  Matthieu Resche-Rigon,et al.  Multiple imputation for handling systematically missing confounders in meta‐analysis of individual participant data , 2013, Statistics in medicine.

[7]  Dan Jackson,et al.  Extending DerSimonian and Laird's methodology to perform multivariate random effects meta‐analyses , 2009, Statistics in medicine.

[8]  Minge Xie,et al.  Efficient network meta-analysis: a confidence distribution approach. , 2014, Statistical methodology.

[9]  Anne Whitehead,et al.  Meta-analysis of individual patient data versus aggregate data from longitudinal clinical trials , 2009, Clinical trials.

[10]  David C. Atkins,et al.  A tutorial on individual participant data meta-analysis using Bayesian multilevel modeling to estimate alcohol intervention effects across heterogeneous studies. , 2019, Addictive behaviors.

[11]  J. Ioannidis Why Most Published Research Findings Are False , 2019, CHANCE.

[12]  Adam R Hafdahl,et al.  Special issue on meta‐analytic structural equation modeling: introduction from the guest editors , 2016, Research synthesis methods.

[13]  Joseph C Cappelleri,et al.  Interpreting indirect treatment comparisons and network meta-analysis for health-care decision making: report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: part 1. , 2011, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[14]  F Gueyffier,et al.  Multivariate meta-analysis using individual participant data , 2014 .

[15]  J F Tierney,et al.  A critical review of methods for the assessment of patient-level interactions in individual participant data meta-analysis of randomized trials, and guidance for practitioners. , 2011, Journal of clinical epidemiology.

[16]  Karla Hemming,et al.  Multivariate meta‐analysis of prognostic factor studies with multiple cut‐points and/or methods of measurement , 2015, Statistics in medicine.

[17]  Kelly S. DeMartini,et al.  Brief alcohol interventions for mandated college students: comparison of face-to-face counseling and computer-delivered interventions. , 2011, Addiction.

[18]  Hendrik Koffijberg,et al.  Individual Participant Data Meta-Analysis for a Binary Outcome: One-Stage or Two-Stage? , 2013, PloS one.

[19]  David C. Atkins,et al.  Project INTEGRATE: An integrative study of brief alcohol interventions for college students. , 2015, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[20]  Mark Simmonds,et al.  A decade of individual participant data meta-analyses: A review of current practice. , 2015, Contemporary clinical trials.

[21]  David C. Atkins,et al.  When less is more and more is less in brief motivational interventions: characteristics of intervention content and their associations with drinking outcomes. , 2014, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[22]  Minge Xie,et al.  Multivariate Meta-Analysis of Heterogeneous Studies Using Only Summary Statistics: Efficiency and Robustness , 2015, Journal of the American Statistical Association.

[23]  Robert D Gibbons,et al.  Multiple imputation for harmonizing longitudinal non‐commensurate measures in individual participant data meta‐analysis , 2015, Statistics in medicine.

[24]  Karel G M Moons,et al.  Meta‐analysis and aggregation of multiple published prediction models , 2014, Statistics in medicine.

[25]  Richard D Riley,et al.  Beyond the Bench: Hunting Down Fugitive Literature , 2004, Environmental Health Perspectives.

[26]  T. Lumley Network meta‐analysis for indirect treatment comparisons , 2002, Statistics in medicine.

[27]  M C Simmonds,et al.  Covariate heterogeneity in meta‐analysis: Criteria for deciding between meta‐regression and individual patient data , 2007, Statistics in medicine.

[28]  F. Collins,et al.  A new initiative on precision medicine. , 2015, The New England journal of medicine.

[29]  Su-Young Kim,et al.  A Hierarchical Multi-Unidimensional IRT Approach for Analyzing Sparse, Multi-Group Data for Integrative Data Analysis , 2015, Psychometrika.

[30]  M. Martens,et al.  Development of the Protective Behavioral Strategies Survey. , 2005, Journal of studies on alcohol.

[31]  D. Kromhout,et al.  Correcting for multivariate measurement error by regression calibration in meta‐analyses of epidemiological studies , 2009, Statistics in medicine.

[32]  Helene R White,et al.  Long-term effects of brief substance use interventions for mandated college students: sleeper effects of an in-person personal feedback intervention. , 2007, Alcoholism, clinical and experimental research.

[33]  Karel G M Moons,et al.  Aggregating published prediction models with individual participant data: a comparison of different approaches , 2012, Statistics in medicine.

[34]  Andrea Cipriani,et al.  Conceptual and Technical Challenges in Network Meta-analysis , 2013, Annals of Internal Medicine.

[35]  D Zeng,et al.  Equity-specific effects of interventions to promote physical activity among middle-aged and older adults: results from applying a novel equity-specific re-analysis strategy , 2021, International Journal of Behavioral Nutrition and Physical Activity.

[36]  Josée Dupuis,et al.  A Method of Moments Estimator for Random Effect Multivariate Meta‐Analysis , 2012, Biometrics.

[37]  Ingram Olkin,et al.  Meta-analysis of effect sizes reported at multiple time points: A multivariate approach , 2012, Clinical trials.

[38]  R. Jennrich,et al.  Unbalanced repeated-measures models with structured covariance matrices. , 1986, Biometrics.

[39]  Daniel Jackson,et al.  A refined method for multivariate meta-analysis and meta-regression , 2013, Statistics in medicine.

[40]  S L Normand,et al.  Meta-analysis: formulating, evaluating, combining, and reporting. , 1999, Statistics in medicine.

[41]  S. Embretson,et al.  The continued search for nonarbitrary metrics in psychology. , 2006, The American psychologist.

[42]  Scott M Hofer,et al.  Integrative data analysis through coordination of measurement and analysis protocol across independent longitudinal studies. , 2009, Psychological methods.

[43]  Karel G M Moons,et al.  Imputation of systematically missing predictors in an individual participant data meta‐analysis: a generalized approach using MICE , 2015, Statistics in medicine.

[44]  A Gasparrini,et al.  Multivariate meta-analysis for non-linear and other multi-parameter associations , 2012, Statistics in medicine.

[45]  David C. Atkins,et al.  Brief motivational interventions for college student drinking may not be as powerful as we think: an individual participant-level data meta-analysis. , 2015, Alcoholism, clinical and experimental research.

[46]  A Gasparrini,et al.  Multivariate meta‐analysis: A method to summarize non‐linear associations , 2011, Statistics in medicine.

[47]  Dan Jackson,et al.  Multivariate meta-analysis: Potential and promise , 2011, Statistics in medicine.

[48]  Ellen Frank,et al.  Computerized Adaptive Diagnosis and Testing of Mental Health Disorders. , 2016, Annual review of clinical psychology.

[49]  R. Riley,et al.  Meta-analysis of individual participant data: rationale, conduct, and reporting , 2010, BMJ : British Medical Journal.

[50]  Thomas A Trikalinos,et al.  An empirical comparison of univariate and multivariate meta‐analyses for categorical outcomes , 2014, Statistics in medicine.