Feasibility of Using Real-World Data to Replicate Clinical Trial Evidence

Key Points Question What percentage of clinical trials published in high-impact journals in 2017 generated evidence that could feasibly be replicated using observational methods and data sources? Findings In this cross-sectional study of 220 clinical trials published in high-impact journals in 2017, only 15% could feasibly be replicated using currently available real-world data sources. Meaning This study suggests that, although the increasing use of real-world evidence in medical research presents opportunities to supplement or even replace some clinical trials, observational methods are not likely to obviate the need for traditional clinical trials.

[1]  Richard Platt,et al.  Launching PCORnet, a national patient-centered clinical research network , 2014, Journal of the American Medical Informatics Association : JAMIA.

[2]  H. Krumholz,et al.  Postapproval studies of drugs initially approved by the FDA on the basis of limited evidence: systematic review , 2017, British Medical Journal.

[3]  Sebastian Schneeweiss,et al.  Accuracy of Medicare claims-based diagnosis of acute myocardial infarction: estimating positive predictive value on the basis of review of hospital records. , 2004, American heart journal.

[4]  Jonathan J. Darrow,et al.  New FDA breakthrough-drug category--implications for patients. , 2014, The New England journal of medicine.

[5]  Harlan M. Krumholz,et al.  Postmarket Safety Events Among Novel Therapeutics Approved by the US Food and Drug Administration Between 2001 and 2010 , 2017, JAMA.

[6]  Fleur Fritz,et al.  Electronic health records to facilitate clinical research , 2016, Clinical Research in Cardiology.

[7]  D. Kent,et al.  Still no closure on the question of PFO closure. , 2013, The New England journal of medicine.

[8]  Justin Starren,et al.  Natural Language Processing for EHR-Based Pharmacovigilance: A Structured Review , 2017, Drug Safety.

[9]  R. Califf,et al.  Real-World Evidence - What Is It and What Can It Tell Us? , 2016, The New England journal of medicine.

[10]  E. Hannan.  Randomized clinical trials and observational studies: guidelines for assessing respective strengths and limitations. , 2008, JACC. Cardiovascular interventions.

[11]  R. W. Hansen,et al.  Journal of Health Economics , 2016 .

[12]  Kevin J. Anstrom,et al.  Accuracy of Medical Claims for Identifying Cardiovascular and Bleeding Events After Myocardial Infarction: A Secondary Analysis of the TRANSLATE-ACS Study , 2017, JAMA cardiology.

[13]  Nihar R Desai,et al.  Real-World Evidence: Promise and Peril For Medical Product Evaluation. , 2018, P & T : a peer-reviewed journal for formulary management.

[14]  Michael E. Matheny,et al.  Registry‐Based Prospective, Active Surveillance of Medical‐Device Safety , 2017, The New England journal of medicine.

[15]  E. Dorsey,et al.  The anatomy of medical research: US and international comparisons. , 2015, JAMA.

[16]  Jerry Avorn,et al.  New "21st Century Cures" Legislation: Speed and Ease vs Science. , 2017, JAMA.