Timing and Characteristics of Cumulative Evidence Available on Novel Therapeutic Agents Receiving Food and Drug Administration Accelerated Approval

Policy Points: Randomized trials-the gold standard of evaluating effectiveness-constitute a small minority of existing evidence on agents given accelerated approval. One-third of randomized trials are in therapeutic areas outside of FDA approval and less than half evaluate the therapeutic benefits of these agents but use them instead as common backbone treatments. Agents receiving accelerated approval are often tested concurrently in several therapeutic areas. For most agents, no substantial time lag is apparent between the average start dates of randomized trials evaluating their effectiveness and those using them as part of background therapies. There appears to be a tendency for therapeutic agents receiving accelerated approval to quickly become an integral component of standard treatment, despite potential shortcomings in their evidence base. CONTEXT Therapeutic agents treating serious conditions are eligible for Food and Drug Administration (FDA) accelerated approval. The clinical evidence accrued on agents receiving accelerated approval has not been systematically evaluated. Our objective was to assess the timing and characteristics of available studies. METHODS We first identified clinical studies of novel therapeutic agents receiving accelerated approval. We then (1) categorized those studies as randomized or nonrandomized, (2) explored whether they evaluated the FDA-approved indications, and (3) documented the available treatment comparisons. We also meta-analyzed the difference in start times between randomized studies that (1) did or did not evaluate approved indications and (2) were or were not designed to evaluate the agent's effectiveness. FINDINGS In total, 37 novel therapeutic agents received accelerated approval between 2000 and 2013. Our search of ClinicalTrials.gov identified 7,757 studies, which included 1,258,315 participants. Only one-third of identified studies were randomized controlled trials. Of 1,631 randomized trials with advanced recruitment status, 906 were conducted in therapeutic areas for which agents received initial accelerated approval, 202 were in supplemental indications, and 523 were outside approved indications. Only 411 out of 906 (45.4%) trials were designed to test the effectiveness of agents that received accelerated approval ("evaluation" trials); others used these agents as common background treatment in both arms ("background" trials). There was no detectable lag between average start times of trials conducted within and outside initially approved indications. Evaluation trials started on average 1.52 years (95% CI: 0.87 to 2.17) earlier than background trials. CONCLUSIONS Cumulative evidence on agents with accelerated approvals has major limitations. Most clinical studies including these agents are small and nonrandomized, and about a third are conducted in unapproved areas, typically concurrently with those conducted in approved areas. Most randomized trials including these therapeutic agents are not designed to directly evaluate their clinical benefits but to incorporate them as standard treatment.

[1]  Jung-Han Kim,et al.  Stereotactic Core-Needle Biopsy of Non-Mass Calcifications: Outcome and Accuracy at Long-Term Follow-Up , 2003, Korean journal of radiology.

[2]  Lisa M. Schwartz,et al.  Physicians' Knowledge About FDA Approval Standards and Perceptions of the "Breakthrough Therapy" Designation. , 2016, JAMA.

[3]  H. Leufkens,et al.  Extensions of indication throughout the drug product lifecycle: a quantitative analysis. , 2016, Drug discovery today.

[4]  Baruch Fischhoff,et al.  A Randomized Trial Testing US Food and Drug Administration "Breakthrough" Language. , 2015, JAMA internal medicine.

[5]  M. Puhan,et al.  Use of surrogate outcomes in US FDA drug approvals, 2003–2012: a survey , 2015, BMJ Open.

[6]  A. Kesselheim,et al.  Characteristics of efficacy evidence supporting approval of supplemental indications for prescription drugs in United States, 2005-14: systematic review , 2015, BMJ : British Medical Journal.

[7]  Jonathan J. Darrow,et al.  Trends in utilization of FDA expedited drug development and approval programs, 1987-2014: cohort study , 2015, BMJ : British Medical Journal.

[8]  V. Prasad,et al.  The Strength of Association Between Surrogate End Points and Survival in Oncology: A Systematic Review of Trial-Level Meta-analyses. , 2015, JAMA internal medicine.

[9]  J. Ioannidis,et al.  How good is "evidence" from clinical studies of drug effects and why might such evidence fail in the prediction of the clinical utility of drugs? , 2015, Annual review of pharmacology and toxicology.

[10]  A. Kesselheim,et al.  FDA Designations for Therapeutics and Their Impact on Drug Development and Regulatory Review Outcomes , 2015, Clinical pharmacology and therapeutics.

[11]  Jonathan J. Darrow,et al.  Drug development and FDA approval, 1938-2013. , 2014, The New England journal of medicine.

[12]  Daniel Carpenter,et al.  Reputation and Power: Organizational Image and Pharmaceutical Regulation at the FDA , 2014 .

[13]  George F Borm,et al.  The Hartung-Knapp-Sidik-Jonkman method for random effects meta-analysis is straightforward and considerably outperforms the standard DerSimonian-Laird method , 2014, BMC Medical Research Methodology.

[14]  John P A Ioannidis,et al.  Improving the drug development process: more not less randomized trials. , 2014, JAMA.

[15]  Harlan M. Krumholz,et al.  Clinical trial evidence supporting FDA approval of novel therapeutic agents, 2005-2012. , 2014, JAMA.

[16]  R. Tibshirani,et al.  Increasing value and reducing waste in research design, conduct, and analysis , 2014, The Lancet.

[17]  Christopher W. Jones,et al.  Non-publication of large randomized clinical trials: cross sectional analysis , 2013, BMJ.

[18]  J. DiMasi Innovating by developing new uses of already-approved drugs: trends in the marketing approval of supplemental indications. , 2013, Clinical therapeutics.

[19]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[20]  J. Ioannidis Mega-trials for blockbusters. , 2013, JAMA.

[21]  I. Cockburn,et al.  The Impact of Incremental Innovation in Biopharmaceuticals , 2006, PharmacoEconomics.

[22]  J. Sterne,et al.  The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials , 2011, BMJ : British Medical Journal.

[23]  Aaron S Kesselheim,et al.  Characteristics of clinical trials to support approval of orphan vs nonorphan drugs for cancer. , 2011, JAMA.

[24]  J. Bijlsma,et al.  Post-approval trials of new medicines: widening use or deepening knowledge? Analysis of 10 years of etanercept , 2011, Scandinavian journal of rheumatology.

[25]  P. Keegan,et al.  Accelerated approval of oncology products: the food and drug administration experience. , 2011, Journal of the National Cancer Institute.

[26]  Nicholas C. Ide,et al.  The ClinicalTrials.gov results database--update and key issues. , 2011, The New England journal of medicine.

[27]  J. Thigpen Issues in Using Progression-Free Survival When Evaluating Oncology Products , 2010 .

[28]  Thomas R Fleming,et al.  Issues in using progression-free survival when evaluating oncology products. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[29]  R. Collins,et al.  Efficacy and safety of cholesterol-lowering treatment: prospective meta-analysis of data from 90 056 participants in 14 randomised trials of statins , 2005, The Lancet.

[30]  J. Ioannidis Contradicted and initially stronger effects in highly cited clinical research. , 2005, JAMA.

[31]  Thomas R Fleming,et al.  Surrogate endpoints and FDA's accelerated approval process. , 2005, Health affairs.

[32]  Richard Pazdur,et al.  Accelerated approval of oncology products: a decade of experience. , 2004, Journal of the National Cancer Institute.

[33]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[34]  M. Mitka Accelerated Approval Scrutinized , 2003 .

[35]  Kurex Sidik,et al.  A simple confidence interval for meta‐analysis , 2002, Statistics in medicine.

[36]  J. Hartung,et al.  A refined method for the meta‐analysis of controlled clinical trials with binary outcome , 2001, Statistics in medicine.

[37]  J. Ioannidis,et al.  Comparison of evidence of treatment effects in randomized and nonrandomized studies. , 2001, JAMA.

[38]  R. Temple,et al.  Therapeutic-class wars--drug promotion in a competitive marketplace. , 1994, The New England journal of medicine.

[39]  R Peto,et al.  Why do we need some large, simple randomized trials? , 1984, Statistics in medicine.