Sources of Safety Data and Statistical Strategies for Design and Analysis: Clinical Trials

Background: There has been an increased emphasis on the proactive and comprehensive evaluation of safety endpoints to ensure patient well-being throughout the medical product life cycle. In fact, depending on the severity of the underlying disease, it is important to plan for a comprehensive safety evaluation at the start of any development program. Statisticians should be intimately involved in this process and contribute their expertise to study design, safety data collection, analysis, reporting (including data visualization), and interpretation. Methods: In this manuscript, we review the challenges associated with the analysis of safety endpoints and describe the safety data that are available to influence the design and analysis of premarket clinical trials. Results: We share our recommendations for the statistical and graphical methodologies necessary to appropriately analyze, report, and interpret safety outcomes, and we discuss the advantages and disadvantages of safety data obtained from clinical trials compared to other sources. Conclusions: Clinical trials are an important source of safety data that contribute to the totality of safety information available to generate evidence for regulators, sponsors, payers, physicians, and patients. This work is a result of the efforts of the American Statistical Association Biopharmaceutical Section Safety Working Group.

[1]  C. Tangen,et al.  Guidelines for data and safety monitoring for clinical trials not requiring traditional data monitoring committees , 2006, Clinical trials.

[2]  R. Goldberg-Alberts,et al.  Multivariate Analysis of Adverse Events , 2006 .

[3]  Tosiya Sato,et al.  A Bayesian meta-analytic approach for safety signal detection in randomized clinical trials , 2017, Clinical trials.

[4]  Friedhelm Leverkus,et al.  Safety data from randomized controlled trials: applying models for recurrent events , 2016, Pharmaceutical statistics.

[5]  J. Lewis,et al.  Statistical principles for clinical trials (ICH E9): an introductory note on an international guideline. , 1999, Statistics in medicine.

[6]  S. Pocock,et al.  Subgroup analysis, covariate adjustment and baseline comparisons in clinical trial reporting: current practiceand problems , 2002, Statistics in medicine.

[7]  I. van Mechelen,et al.  Qualitative interaction trees: a tool to identify qualitative treatment–subgroup interactions , 2014, Statistics in medicine.

[8]  Taxiarchis Botsis,et al.  Seeing is believing: good graphic design principles for medical research , 2015, Statistics in medicine.

[9]  P. Mozzicato,et al.  Standardised MedDRA Queries , 2007, Drug safety.

[10]  William DuMouchel,et al.  Empirical bayes screening for multi-item associations , 2001, KDD '01.

[11]  M. Gordon.  Dasatinib versus Imatinib in Newly Diagnosed Chronic-Phase Chronic Myeloid Leukemia , 2010 .

[12]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[13]  Hui Quan,et al.  Assessment of Consistency of Treatment Effects in Multiregional Clinical Trials , 2010 .

[14]  J. Goodwin,et al.  Congestive heart failure in older women treated with adjuvant anthracycline chemotherapy for breast cancer. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[15]  P F Thall,et al.  New statistical strategy for monitoring safety and efficacy in single-arm clinical trials. , 1996, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[16]  S. Day,et al.  Drug Safety Assessment in Clinical Trials. , 1994 .

[17]  Jonas H. Ellenberg,et al.  Intent-to-Treat Analysis versus As-Treated Analysis , 1996 .

[18]  Steven Snapinn,et al.  Statistical Considerations on the Evaluation of Imbalances of Adverse Events in Randomized Clinical Trials , 2015, Therapeutic innovation & regulatory science.

[19]  B. Turnbull,et al.  Group Sequential Methods with Applications to Clinical Trials , 1999 .

[20]  Jerald F. Lawless,et al.  Some Simple Robust Methods for the Analysis of Recurrent Events , 1995 .

[21]  Christy Chuang-Stein,et al.  Recent Advancements in the Analysis and Presentation of Safety Data , 2001 .

[22]  Manuel Ayala,et al.  Dasatinib versus imatinib in newly diagnosed chronic-phase chronic myeloid leukemia. , 2010, The New England journal of medicine.

[24]  P F Thall,et al.  Treatment Comparisons Based on Two‐Dimensional Safety and Efficacy Alternatives in Oncology Trials , 1999, Biometrics.

[25]  Joel B Greenhouse,et al.  Do antidepressants cause suicidality in children? A Bayesian meta-analysis , 2006, Clinical trials.

[26]  Peter F Thall,et al.  Some Geometric Methods for Constructing Decision Criteria Based On Two-Dimensional Parameters. , 2008, Journal of statistical planning and inference.

[27]  Mohamed Alosh,et al.  Statistical Considerations on Subgroup Analysis in Clinical Trials , 2015 .

[28]  W. D. Ray.  4. Modelling Survival Data in Medical Research , 1995 .

[29]  Antonio Ciampi,et al.  Tree-structured subgroup analysis for censored survival data: Validation of computationally inexpensive model selection criteria , 2005, Stat. Comput..

[30]  M. Schumacher,et al.  Analysing adverse events by time‐to‐event models: the CLEOPATRA study , 2016, Pharmaceutical statistics.

[31]  D. Mehrotra,et al.  Flagging clinical adverse experiences: reducing false discoveries without materially compromising power for detecting true signals , 2012, Statistics in medicine.

[32]  William M. Stanish.  Categorical data analysis strategies using SAS software , 1986 .

[33]  M R Conaway,et al.  Bivariate sequential designs for phase II trials. , 1995, Biometrics.

[34]  R. Cook,et al.  Statistical analysis of recurrent adverse events , 2014 .

[36]  Guideline on the investigation of subgroups in confirmatory clinical trials , 2014 .

[37]  J. Bryant,et al.  Incorporating toxicity considerations into the design of two-stage phase II clinical trials. , 1995, Biometrics.

[38]  Evaluation and Review of Strategies to Assess Cardiovascular Risk in Clinical Trials in Patients with Type 2 Diabetes Mellitus , 2015 .

[39]  Russell D. Wolfinger,et al.  The contributions of sex, genotype and age to transcriptional variance in Drosophila melanogaster , 2001, Nature Genetics.

[40]  A. Ivanova,et al.  Enrollment and Stopping Rules for Managing Toxicity Requiring Long Follow-Up in Phase II Oncology Trials , 2015, Journal of biopharmaceutical statistics.

[41]  M R Conaway,et al.  Designs for phase II trials allowing for a trade-off between response and toxicity. , 1996, Biometrics.

[42]  Brian J Smith,et al.  Adaptive group sequential design for phase II clinical trials: A Bayesian decision theoretic approach , 2009, Statistics in medicine.

[43]  Jesse A. Berlin,et al.  Meta-analysis of clinical trial safety data in a drug development program: Answers to frequently asked questions , 2013, Clinical trials.

[44]  H Amy Xia,et al.  Planning and core analyses for periodic aggregate safety data reviews , 2011, Clinical trials.

[45]  Abdulkadir Hussein,et al.  Statistical Monitoring of Clinical Trials , 2008, Technometrics.

[46]  Stephen Senn,et al.  Statistical Issues in Drug Development (Second edition) , 2007 .

[47]  Rajeev Motwani,et al.  Beyond Market Baskets: Generalizing Association Rules to Dependence Rules , 1998, Data Mining and Knowledge Discovery.

[48]  N. Tatonetti,et al.  The Weber Effect and the United States Food and Drug Administration’s Adverse Event Reporting System (FAERS): Analysis of Sixty-Two Drugs Approved from 2006 to 2010 , 2014, Drug Safety.

[49]  P. Thall,et al.  Bayesian sequential monitoring designs for single-arm clinical trials with multiple outcomes. , 1995, Statistics in medicine.

[50]  Richard C. Zink,et al.  Sources of Safety Data and Statistical Strategies for Design and Analysis: Postmarket Surveillance , 2018, Therapeutic innovation & regulatory science.

[51]  David L. DeMets,et al.  Data Monitoring Committees in Clinical Trials , 2002 .

[52]  William DuMouchel,et al.  Bayesian Data Mining in Large Frequency Tables, with an Application to the FDA Spontaneous Reporting System , 1999 .

[53]  B. Wiens,et al.  The role of intention to treat in analysis of noninferiority studies , 2007, Clinical trials.

[54]  Qi Jiang,et al.  Sources of Safety Data and Statistical Strategies for Design and Analysis: Real World Insights , 2018, Therapeutic innovation & regulatory science.

[55]  J. M. Taylor,et al.  Subgroup identification from randomized clinical trial data , 2011, Statistics in medicine.

[56]  Xiaogang Su,et al.  Subgroup Analysis via Recursive Partitioning , 2009 .

[57]  D L DeMets,et al.  Interim analysis: the alpha spending function approach. , 1994, Statistics in medicine.

[58]  Lucia Nemčíková,et al.  Classification and Regression Trees in R , 2014 .

[59]  Yi Tsong,et al.  ISSUES RELATED TO SUBGROUP ANALYSIS IN CLINICAL TRIALS , 2002, Journal of biopharmaceutical statistics.

[60]  Jesse A Berlin,et al.  Recommendations for safety planning, data collection, evaluation and reporting during drug, biologic and vaccine development: a report of the safety planning, evaluation, and reporting team , 2009, Clinical trials.

[61]  E. Brown,et al.  The Medical Dictionary for Regulatory Activities (MedDRA) , 1999, Drug safety.

[62]  Y. Benjamini,et al.  False Discovery Rate–Adjusted Multiple Confidence Intervals for Selected Parameters , 2005 .

[63]  Richard C. Zink,et al.  Assessment of Methods to Identify Patient Subgroups with Enhanced Treatment Response in Randomized Clinical Trials , 2015 .

[64]  Zhenzhen Xu,et al.  Propensity Score Matching in Randomized Clinical Trials , 2010, Biometrics.

[65]  Xun Chen,et al.  Choosing the analysis population in non‐inferiority studies: per protocol or intent‐to‐treat , 2006, Statistics in medicine.

[66]  Richard C. Zink,et al.  Rethinking the Clinically Based Thresholds of TransCelerate BioPharma for Risk-Based Monitoring , 2018, Therapeutic innovation & regulatory science.

[67]  S. Senn.  Disappointing dichotomies , 2003 .

[68]  Stephen W Lagakos,et al.  Statistics in medicine--reporting of subgroup analyses in clinical trials. , 2007, The New England journal of medicine.

[69]  Steff Lewis,et al.  Forest plots: trying to see the wood and the trees , 2001, BMJ : British Medical Journal.

[70]  Richard C. Zink,et al.  On the Importance of a Single Data Standard , 2012 .

[71]  M. Lindquist.  VigiBase, the WHO Global ICSR Database System: Basic Facts , 2008 .

[72]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[73]  Claudia Schmoor,et al.  Statistical issues in the analysis of adverse events in time‐to‐event data , 2016, Pharmaceutical statistics.

[74]  P F Thall,et al.  Some extensions and applications of a Bayesian strategy for monitoring multiple outcomes in clinical trials. , 1998, Statistics in medicine.

[75]  William DuMouchel,et al.  Multivariate Bayesian Logistic Regression for Analysis of Clinical Study Safety Issues , 2012, 1210.0385.

[76]  Peter C Gøtzsche,et al.  [Better reporting of harms in randomized trials: an extension of the CONSORT statement]. , 2005, Ugeskrift for laeger.

[77]  Ilya Lipkovich,et al.  Strategies for Identifying Predictive Biomarkers and Subgroups with Enhanced Treatment Effect in Clinical Trials Using SIDES , 2014, Journal of biopharmaceutical statistics.

[78]  J. Torner,et al.  A randomized controlled trial of high-dose intravenous nicardipine in aneurysmal subarachnoid hemorrhage. A report of the Cooperative Aneurysm Study. , 1993, Journal of neurosurgery.

[79]  Kenneth Liu,et al.  Confidence intervals for an exposure adjusted incidence rate difference with applications to clinical trials , 2006, Statistics in medicine.

[80]  Zhiliang Ying,et al.  Semiparametric regression for the mean and rate functions of recurrent events , 2000 .

[81]  M. Hanefeld,et al.  Rosiglitazone evaluated for cardiovascular outcomes in oral agent combination therapy for type 2 diabetes (RECORD): a multicentre, randomised, open-label trial , 2009, The Lancet.

[82]  Susan P Duke,et al.  Quantitative Methods for Safety Monitoring of Rare Serious Adverse Events , 2017, Pharmaceutical Medicine.

[83]  Steven Snapinn,et al.  Choosing Appropriate Metrics to Evaluate Adverse Events in Safety Evaluation , 2015, Therapeutic innovation & regulatory science.

[84]  S. Lagakos.  The challenge of subgroup analyses--reporting without distorting. , 2006, The New England journal of medicine.

[85]  I. Lipkovich,et al.  Subgroup identification based on differential effect search—A recursive partitioning method for establishing response to treatment in patient subpopulations , 2011, Statistics in medicine.

[86]  Scott M Berry,et al.  Accounting for Multiplicities in Assessing Drug Safety: A Three‐Level Hierarchical Mixture Model , 2004, Biometrics.

[87]  Peter W Lane,et al.  Graphical approaches to the analysis of safety data from clinical trials , 2008, Pharmaceutical statistics.

[88]  Christy Chuang-Stein,et al.  The Probability of Observing Negative Subgroup Results When the Treatment Effect is Positive and Homogeneous across All Subgroups , 2007 .

[89]  D. Machin,et al.  Intention to treat--who should use ITT? , 1993, British Journal of Cancer.

[90]  Qi Jiang,et al.  Quantitative Evaluation of Safety in Drug Development : Design, Analysis and Reporting , 2014 .

[91]  S. Nissen,et al.  Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. , 2007, The New England journal of medicine.

[92]  Ling Lan,et al.  Statistical Methods for Evaluating Safety in Medical Product Development A. Lawrence Gould John Wiley & Sons, 2015, 400 pages, $99.95, hardcover ISBN: 978-1-119-97966-1 , 2018, International Statistical Review.

[93]  Valerii Fedorov,et al.  Consequences of dichotomization , 2009, Pharmaceutical statistics.

[94]  Patricia M. Grambsch,et al.  Data Monitoring Committees in Clinical Trials: A Practical Perspective. , 2003 .

[95]  J. Bergh,et al.  Trastuzumab-associated cardiac adverse effects in the herceptin adjuvant trial. , 2007, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[96]  Wayne B. Nelson.  1. Recurrent Events Data and Applications , 2003 .

[97]  P. Schnell,et al.  A Bayesian Exposure-Time Method for Clinical Trial Safety Monitoring With Blinded Data , 2016, Therapeutic innovation & regulatory science.

[98]  Bradley P. Carlin,et al.  Bayesian Hierarchical Modeling for Detecting Safety Signals in Clinical Trials , 2011, Journal of biopharmaceutical statistics.

[99]  R. W. Hansen,et al.  Journal of Health Economics , 2016 .

[100]  Richard C. Zink,et al.  Statistical Considerations for Cardiovascular Outcome Trials in Patients with Type 2 Diabetes Mellitus , 2017 .

[101]  R. Bender,et al.  Biometrical issues in the analysis of adverse events within the benefit assessment of drugs , 2016, Pharmaceutical statistics.