Selecting and Integrating Data Sources in Benefit–Risk Assessment: Considerations and Future Directions

ABSTRACT A key challenge in benefit–risk (B-R) assessment of a medication is the multitude of data sources and the changing quality and relevance of these sources during the medication lifecycle. At the time of regulatory approval, B-R assessment is largely based on data from controlled clinical trials and preclinical studies. Following approval, data informing B-R accumulate in a broader, larger sample of subjects in clinical practice and post-approval studies, and it can be challenging to know how to appropriately aggregate and compare these datasets. In this article, we critically evaluate different data sources that may be used in B-R assessment, including controlled trials, observational data, and spontaneous reports. We demonstrate how these sources may be used to create an effects table (summary of evidence of key efficacy and safety data), using dabigatran, a nonvitamin K antagonist oral anticoagulant (NOAC), as a case example. We discuss how to compare quantitatively across studies when populations are disparate (baseline characteristics, susceptibility to adverse effects) or when there are data from multiple sources. We also discuss future directions of B-R assessment using emerging data sources and methods and the potential to use mechanistic insights from preclinical and clinical studies to support B-R assessment.

[1]  J. Berlin,et al.  Sources of Data to Enable Benefit–Risk Assessment , 2017 .

[2]  Shahrul Mt-Isa,et al.  Structured Benefit–risk assessment: a review of key publications and initiatives on frameworks and methodologies , 2016, Pharmaceutical statistics.

[3]  Jeffery L. Painter,et al.  Social Media Listening for Routine Post-Marketing Safety Surveillance , 2016, Drug Safety.

[4]  Shahrul Mt-Isa,et al.  A Bayesian approach to probabilistic sensitivity analysis in structured benefit‐risk assessment , 2016, Biometrical journal. Biometrische Zeitschrift.

[5]  J. Beyer-Westendorf,et al.  Effectiveness and safety of rivaroxaban therapy in daily-care patients with atrial fibrillation , 2015, Thrombosis and Haemostasis.

[6]  Diane P. Martin,et al.  Comparison of Benefit-Risk Assessment Methods for Prospective Monitoring of Newly Marketed Drugs: A Simulation Study. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[7]  Diane P. Martin,et al.  Prospective Benefit-Risk Monitoring of New Drugs for Rapid Assessment of Net Favorability in Electronic Health Care Data. , 2015, Value in health : the journal of the International Society for Pharmacoeconomics and Outcomes Research.

[8]  J. Johnston,et al.  A literature review on the representativeness of randomized controlled trial samples and implications for the external validity of trial results , 2015, Trials.

[9]  J. Beyer-Westendorf,et al.  Effectiveness and safety of dabigatran therapy in daily-care patients with atrial fibrillation , 2015, Thrombosis and Haemostasis.

[10]  Ortwin Renn,et al.  Structured Frameworks to Increase the Transparency of the Assessment of Benefits and Risks of Medicines: Current Status and Possible Future Directions , 2015, Clinical pharmacology and therapeutics.

[11]  Erin Bastick FDA approves first reversal agent for anticoagulant Pradaxa , 2015 .

[12]  Jeremy Sugarman,et al.  Exploring the ethical and regulatory issues in pragmatic clinical trials , 2015, Clinical trials.

[13]  Rumi Chunara,et al.  Flu Near You: Crowdsourced Symptom Reporting Spanning 2 Influenza Seasons. , 2015, American journal of public health.

[14]  John S. Brownstein,et al.  Increasing Patient Engagement in Pharmacovigilance Through Online Community Outreach and Mobile Reporting Applications: An Analysis of Adverse Event Reporting for the Essure Device in the US , 2015, Pharmaceutical Medicine.

[15]  I. Hernandez Time to Reconsider Dabigatran 110 mg in the USA , 2015, American Journal of Cardiovascular Drugs.

[16]  G. Lip,et al.  Stroke prevention in atrial fibrillation: a systematic review. , 2015, JAMA.

[17]  E. Chiauzzi,et al.  Patient-centered activity monitoring in the self-management of chronic health conditions , 2015, BMC Medicine.

[18]  M. Khoury,et al.  Opportunities for Translational Epidemiology: The Important Role of Observational Studies to Advance Precision Oncology , 2015, Cancer Epidemiology, Biomarkers & Prevention.

[19]  Mark Levenson,et al.  Cardiovascular, Bleeding, and Mortality Risks in Elderly Medicare Patients Treated With Dabigatran or Warfarin for Nonvalvular Atrial Fibrillation , 2015, Circulation.

[20]  Yu-Chuan Li,et al.  Observational Health Data Sciences and Informatics (OHDSI): Opportunities for Observational Researchers , 2015, MedInfo.

[21]  Douglas G Altman,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. , 2014, International journal of surgery.

[22]  Michele Jonsson Funk,et al.  Misclassification in Administrative Claims Data: Quantifying the Impact on Treatment Effect Estimates , 2014, Current Epidemiology Reports.

[23]  Ram C. Tiwari,et al.  A Bayesian Approach for Benefit-Risk Assessment , 2014 .

[24]  J. Berlin,et al.  Relative importance of benefits and risks associated with antithrombotic therapies for acute coronary syndrome: patient and physician perspectives , 2014, Current medical research and opinion.

[25]  Richard Platt,et al.  Launching PCORnet, a national patient-centered clinical research network , 2014, Journal of the American Medical Informatics Association : JAMIA.

[26]  L. Bero,et al.  Healthcare outcomes assessed with observational study designs compared with those assessed in randomized trials. , 2014, The Cochrane database of systematic reviews.

[27]  A. Woodcock,et al.  Obtaining real-world evidence: the Salford Lung Study , 2014, Thorax.

[28]  G. Lip,et al.  Design and rationale of Global Registry on Long-Term Oral Antithrombotic Treatment in Patients with Atrial Fibrillation: a global registry program on long-term oral antithrombotic treatment in patients with atrial fibrillation. , 2014, American heart journal.

[29]  U. Schotten,et al.  Pleiotropic effects of factor Xa and thrombin: what to expect from novel anticoagulants. , 2014, Cardiovascular research.

[30]  Mukul Sharma,et al.  Evaluation of patients’ attitudes towards stroke prevention and bleeding risk in atrial fibrillation , 2013, Thrombosis and Haemostasis.

[31]  R B D'Agostino,et al.  A Proposal for Integrated Efficacy-to-Effectiveness (E2E) Clinical Trials , 2013, Clinical pharmacology and therapeutics.

[32]  William DuMouchel,et al.  Interpreting observational studies: why empirical calibration is needed to correct p-values , 2013, Statistics in medicine.

[33]  D. Madigan,et al.  Evaluating the impact of database heterogeneity on observational study results. , 2013, American journal of epidemiology.

[34]  Marsha E Reichman,et al.  Dabigatran and postmarketing reports of bleeding. , 2013, The New England journal of medicine.

[35]  D. Madigan,et al.  Does design matter? Systematic evaluation of the impact of analytical choices on effect estimates in observational studies , 2013, Therapeutic advances in drug safety.

[36]  Rebecca Noel,et al.  Application of the Benefit-Risk Action Team (BRAT) Framework in Pharmaceutical R&D: Results From a Pilot Program , 2012 .

[37]  Lawrence D. Phillips,et al.  Evaluating benefit-risk: an Agency perspective , 2012 .

[38]  E. Terecoasă,et al.  Oral anticoagulation related intracerebral hemorrhage: more questions than answers , 2012, Romanian Journal of Neurology.

[39]  E. Unger,et al.  Anticoagulant options--why the FDA approved a higher but not a lower dose of dabigatran. , 2011, The New England journal of medicine.

[40]  S Walker,et al.  Refining the Benefit–Risk Framework for the Assessment of Medicines: Valuing and Weighting Benefit and Risk Parameters , 2011, Clinical pharmacology and therapeutics.

[41]  B S Levitan,et al.  Development of a Framework for Enhancing the Transparency, Reproducibility and Communication of the Benefit–Risk Balance of Medicines , 2011, Clinical pharmacology and therapeutics.

[42]  B S Levitan,et al.  Application of the BRAT Framework to Case Studies: Observations and Insights , 2011, Clinical pharmacology and therapeutics.

[43]  S. Cole,et al.  Generalizing evidence from randomized clinical trials to target populations: The ACTG 320 trial. , 2010, American journal of epidemiology.

[44]  F. Collins,et al.  Patient-Centered Outcomes Research Institute: The Intersection of Science and Health Care , 2010, Science Translational Medicine.

[45]  J. Frost,et al.  Sharing Health Data for Better Outcomes on PatientsLikeMe , 2010, Journal of medical Internet research.

[46]  D Bergqvist,et al.  Definition of major bleeding in clinical investigations of antihemostatic medicinal products in surgical patients , 2010, Journal of thrombosis and haemostasis : JTH.

[47]  Arthur A M Wilde,et al.  Cardiac ion channels in health and disease. , 2010, Heart rhythm.

[48]  E. Unger,et al.  Weighing benefits and risks--the FDA's review of prasugrel. , 2009, The New England journal of medicine.

[49]  S. Yusuf,et al.  Dabigatran versus warfarin in patients with atrial fibrillation. , 2009, The New England journal of medicine.

[50]  D. Singer,et al.  The Net Clinical Benefit of Warfarin Anticoagulation in Atrial Fibrillation , 2009, Annals of Internal Medicine.

[51]  J. Avorn,et al.  High-dimensional Propensity Score Adjustment in Studies of Treatment Effects Using Health Care Claims Data , 2009, Epidemiology.

[52]  R. Tannen,et al.  Use of primary care electronic medical record database in drug efficacy research on cardiovascular outcomes: comparison of database and randomised controlled trial findings , 2009, BMJ : British Medical Journal.

[53]  M. Peppelenbosch,et al.  Factor Xa: at the crossroads between coagulation and signaling in physiology and disease. , 2008, Trends in molecular medicine.

[54]  E. Hannan Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. , 2008, JACC. Cardiovascular interventions.

[55]  S. Pocock,et al.  The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. , 2007, Preventive medicine.

[56]  S. Schulman,et al.  Definition of major bleeding in clinical investigations of antihemostatic medicinal products in non‐surgical patients , 2005, Journal of thrombosis and haemostasis : JTH.

[57]  M W Gillman,et al.  Interpretation of observational studies , 2004, Heart.

[58]  A. Waldo Stroke prevention in atrial fibrillation. , 2003, JAMA.

[59]  Mark E. Anderson,et al.  Cardiac ion channels. , 2002, Annual review of physiology.

[60]  Catherine P. Bradshaw,et al.  The use of propensity scores to assess the generalizability of results from randomized trials , 2011, Journal of the Royal Statistical Society. Series A,.

[61]  C. Mastroianni,et al.  [The net clinical benefit]. , 1999, Minerva Medica.

[62]  M. Forsting,et al.  Anticoagulation-Related Intracerebral Hemorrhage , 1991 .

[63]  John Trevitt Does design matter? , 1988 .

[64]  R J DUBOS,et al.  Health and disease. , 1960, JAMA.