Drug safety assessment in clinical trials: methodological challenges and opportunities

Randomized controlled trials are the principal means of establishing the efficacy of drugs. However pre-marketing trials are limited in size and duration and exclude high-risk populations. They have limited statistical power to detect rare but potentially serious adverse events in real-world patients. We summarize the principal methodological challenges in the reporting, analysis and interpretation of safety data in clinical trials using recent examples from systematic reviews. These challenges include the lack of an evidentiary gold standard, the limited statistical power of randomized controlled trials and resulting type 2 error, the lack of adequate ascertainment of adverse events and limited generalizability of trials that exclude high risk patients. We discuss potential solutions to these challenges. Evaluation of drug safety requires careful examination of data from heterogeneous sources. Meta-analyses of drug safety should include appropriate statistical methods and assess the optimal information size to avoid type 2 errors. They should evaluate outcome reporting biases and missing data to ensure reliable and accurate interpretation of findings. Regulatory and academic partnerships should be fostered to provide an independent and transparent evaluation of drug safety.

[1]  C. Furberg,et al.  Long-term use of thiazolidinediones and fractures in type 2 diabetes: a meta-analysis , 2009, Canadian Medical Association Journal.

[2]  Sonal Singh,et al.  Comparative cardiovascular effects of thiazolidinediones: systematic review and meta-analysis of observational studies , 2011, BMJ : British Medical Journal.

[3]  Su Golder,et al.  Meta-analyses of Adverse Effects Data Derived from Randomised Controlled Trials as Compared to Observational Studies: Methodological Overview , 2011, PLoS medicine.

[4]  C. Furberg,et al.  Risk of serious adverse cardiovascular events associated with varenicline: a systematic review and meta-analysis , 2011, Canadian Medical Association Journal.

[5]  C. Granger,et al.  Do we need to adjudicate major clinical events? , 2008, Clinical trials.

[6]  Galit Shmueli,et al.  Fundamentals of Clinical Trials, 4th edition , 2012 .

[7]  J. Prochaska,et al.  Risk of cardiovascular serious adverse events associated with varenicline use for tobacco cessation: systematic review and meta-analysis , 2012, BMJ : British Medical Journal.

[8]  S. Golder,et al.  Comprehensive evaluations of the adverse effects of drugs: importance of appropriate study selection and data sources , 2011, Therapeutic advances in drug safety.

[9]  J. Aronson,et al.  A comparison of three different sources of data in assessing the frequencies of adverse reactions to amiodarone. , 2004, British journal of clinical pharmacology.

[10]  Mark S Levenson,et al.  Risk of suicidality in clinical trials of antidepressants in adults: analysis of proprietary data submitted to US Food and Drug Administration , 2009, BMJ : British Medical Journal.

[11]  C. Furberg,et al.  The FDA and new safety warnings. , 2012, Archives of internal medicine.

[12]  C. Furberg,et al.  Inhaled anticholinergics and risk of major adverse cardiovascular events in patients with chronic obstructive pulmonary disease: a systematic review and meta-analysis. , 2008, JAMA.

[13]  J. Maurer Mortality associated with tiotropium mist inhaler in patients with chronic obstructive pulmonary disease: systematic review and meta-analysis of randomised controlled trials , 2012 .

[14]  J. Nunnelee Review of an article: The ADVANCE Collaborative Group. (2008). Intensive Blood Glucose Control and Vascular Outcomes in Patients with Type 2 Diabetes. NEJM 2008;358:2560-2572. , 2008 .

[15]  Guosheng Yin,et al.  Fundamentals of Clinical Trials , 2012 .

[16]  Grant D. Huang,et al.  Glucose control and vascular complications in veterans with type 2 diabetes. , 2009, The New England journal of medicine.

[17]  M. Harrison‐Woolrych,et al.  Cardiovascular Events in Patients taking Varenicline , 2012, Drug Safety.

[18]  R. Holman,et al.  Effect of intensive blood-glucose control with metformin on complications in overweight patients with type 2 diabetes (UKPDS 34) , 1998, The Lancet.

[19]  M. Viswanathan,et al.  Assessing equivalence and noninferiority. , 2012, Journal of clinical epidemiology.

[20]  Peter W Lane,et al.  Meta-analysis of incidence of rare events , 2013, Statistical methods in medical research.

[21]  Yoon K Loke,et al.  Long-term risk of cardiovascular events with rosiglitazone: a meta-analysis. , 2007, JAMA.

[22]  Kay Dickersin,et al.  Outcome reporting in industry-sponsored trials of gabapentin for off-label use. , 2009, The New England journal of medicine.

[23]  Diederick Grobbee,et al.  Intensive blood glucose control and vascular outcomes in patients with type 2 diabetes. , 2008, The New England journal of medicine.

[24]  Alexander J Sutton,et al.  What to add to nothing? Use and avoidance of continuity corrections in meta-analysis of sparse data. , 2004, Statistics in medicine.

[25]  Michael E. Miller,et al.  Effects of intensive glucose lowering in type 2 diabetes. , 2008, The New England journal of medicine.

[26]  Jonathan J Deeks,et al.  Much ado about nothing: a comparison of the performance of meta‐analytical methods with rare events , 2007, Statistics in medicine.

[27]  Curt D. Furberg,et al.  Suicidal Behavior and Depression in Smoking Cessation Treatments , 2011, PloS one.

[28]  Michael E. Miller,et al.  ACTION TO CONTROL CARDIOVASCULAR RISK IN DIABETES STUDY GROUP. EFFECTS OF INTENSIVE GLUCOSE LOWERING IN TYPE 2 DIABETES , 2010 .

[29]  J. Woodcock,et al.  New FDA regulation to improve safety reporting in clinical trials. , 2011, The New England journal of medicine.

[30]  Christine M. Micheel,et al.  Evaluation of Biomarkers and Surrogate Endpoints in Chronic Disease , 2010 .

[31]  Erland Erdmann,et al.  Secondary prevention of macrovascular events in patients with type 2 diabetes in the PROactive Study (PROspective pioglitAzone Clinical Trial In macroVascular Events): a randomised controlled trial , 2005, The Lancet.

[32]  Yoon K Loke,et al.  Long-term use of inhaled corticosteroids and the risk of pneumonia in chronic obstructive pulmonary disease: a meta-analysis. , 2009, Archives of internal medicine.

[33]  S. Nissen,et al.  Effect of rosiglitazone on the risk of myocardial infarction and death from cardiovascular causes. , 2007, The New England journal of medicine.

[34]  Y. Loke,et al.  Risk of gastrointestinal haemorrhage with long term use of aspirin: meta-analysis , 2000, BMJ : British Medical Journal.

[35]  G. Guyatt,et al.  Efficacy and safety of statin treatment for cardiovascular disease: a network meta-analysis of 170,255 patients from 76 randomized trials. , 2011, QJM : monthly journal of the Association of Physicians.

[36]  S. Schinner,et al.  Intensive Blood Glucose Control and Vascular Outcomes in Patients with Type 2 Diabetes , 2009 .

[37]  Amy T. Wang,et al.  Association between industry affiliation and position on cardiovascular risk with rosiglitazone: cross sectional systematic review , 2010, BMJ : British Medical Journal.

[38]  LJ Lesko,et al.  Pharmacological Mechanism‐Based Drug Safety Assessment and Prediction , 2011, Clinical pharmacology and therapeutics.

[39]  R. Ferner Newly licensed drugs , 1996, BMJ.

[40]  Nicholas C. Ide,et al.  The ClinicalTrials.gov results database--update and key issues. , 2011, The New England journal of medicine.

[41]  P. Enright,et al.  Pro-arrhythmic and pro-ischaemic effects of inhaled anticholinergic medications , 2012, Thorax.

[42]  Sonal Singh,et al.  Risk of pneumonia associated with long-term use of inhaled corticosteroids in chronic obstructive pulmonary disease: a critical review and update , 2010, Current opinion in pulmonary medicine.

[43]  M. Hanefeld,et al.  Rosiglitazone evaluated for cardiovascular outcomes in oral agent combination therapy for type 2 diabetes (RECORD): a multicentre, randomised, open-label trial , 2009, The Lancet.

[44]  T. Hammad,et al.  Secondary use of randomized controlled trials to evaluate drug safety: a review of methodological considerations , 2011, Clinical trials.

[45]  Janet Woodcock,et al.  Role of postmarketing surveillance in contemporary medicine. , 2011, Annual review of medicine.

[46]  M. Decramer,et al.  A 4-year trial of tiotropium in chronic obstructive pulmonary disease. , 2008, The New England journal of medicine.

[47]  Y. Loke,et al.  Effects of Proton Pump Inhibitors on Platelet Function in Patients Receiving Clopidogrel , 2012, Drug Safety.

[48]  Tianjing Li,et al.  Network meta-analysis-highly attractive but more methodological research is needed , 2011, BMC medicine.

[49]  C. Furberg,et al.  Long-term use of thiazolidinediones and the associated risk of pneumonia or lower respiratory tract infection: systematic review and meta-analysis , 2011, Thorax.

[50]  N. Rigotti,et al.  Efficacy and Safety of Varenicline for Smoking Cessation in Patients With Cardiovascular Disease: A Randomized Trial , 2010, Circulation.