Historical Controls in Randomized Clinical Trials: Opportunities and Challenges

Randomized control trials (RCTs) with placebo are the gold standard for determining efficacy of novel pharmaceutical treatments. Since their inception, over 75 years ago, researchers have amassed a large body of underutilized data on outcomes in the placebo control arms of these trials. Although rare disease indications have used these historical placebo data as synthetic controls to reduce burden on patients and accelerate drug discovery, broad use of historical controls is in its infancy. Large‐scale historical placebo data could be leveraged to benefit both drug developers and patients if warehoused and made more available to guide trial design and analysis. Here, we examine challenges in utilizing historical controls related to heterogeneity in trial design, outcome ascertainment, patient characteristics, and unmeasured pharmacogenomic effects. We then discuss the advantages and disadvantages of current approaches and propose a path forward to broader use of historical controls in RCTs.

[1]  F. Hakim,et al.  Modulation of anti-tumor immunity by the brain’s reward system , 2018, Nature Communications.

[2]  Vilfredo De Pascalis,et al.  The contribution of suggestibility and expectation to placebo analgesia phenomenon in an experimental setting , 2002, Pain.

[3]  R. Brook,et al.  A review of blood pressure measurement protocols among hypertension trials: implications for "evidence-based" clinical practice. , 2014, Journal of the American Society of Hypertension : JASH.

[4]  Akshay S. Desai,et al.  Regional Variation in Patients and Outcomes in the Treatment of Preserved Cardiac Function Heart Failure With an Aldosterone Antagonist (TOPCAT) Trial , 2015, Circulation.

[5]  C. Grady,et al.  What makes clinical research ethical? , 2000, JAMA.

[6]  Donald B. Rubin,et al.  Matching with Multiple Control Groups , and Adjusting for Group Differences , 2005 .

[7]  Donald B. Rubin,et al.  Matching With Multiple Control Groups With Adjustment for Group Differences , 2008 .

[8]  D. Moerman Cultural variations in the placebo effect: ulcers, anxiety, and blood pressure. , 2000, Medical anthropology quarterly.

[9]  S. Langenecker,et al.  Association Between Placebo-Activated Neural Systems and Antidepressant Responses: Neurochemistry of Placebo Effects in Major Depression. , 2015, JAMA psychiatry.

[10]  David S. Miller,et al.  Comparing recruitment, retention, and safety reporting among geographic regions in multinational Alzheimer’s disease clinical trials , 2015, Alzheimer's Research & Therapy.

[11]  J. Hebebrand,et al.  Placebo response rates and potential modifiers in double-blind randomized controlled trials of second and newer generation antidepressants for major depressive disorder in children and adolescents: a systematic review and meta-regression analysis , 2018, European Child & Adolescent Psychiatry.

[12]  S. M. Vambheim,et al.  A systematic review of sex differences in the placebo and the nocebo effect , 2017, Journal of pain research.

[13]  P. Sadler,et al.  Side effects can enhance treatment response through expectancy effects: an experimental analgesic randomized controlled trial , 2017, Pain.

[14]  N. Cook,et al.  Assessment of Placebo Response in Objective and Subjective Outcome Measures in Rheumatoid Arthritis Clinical Trials , 2020, JAMA network open.

[15]  S. Woods,et al.  Control group bias in randomized atypical antipsychotic medication trials for schizophrenia. , 2005, Archives of general psychiatry.

[16]  Russ B. Altman,et al.  Examining the Use of Real‐World Evidence in the Regulatory Process , 2019, Clinical pharmacology and therapeutics.

[17]  S J Pocock,et al.  The combination of randomized and historical controls in clinical trials. , 1976, Journal of chronic diseases.

[18]  W. Brown,et al.  Does the increasing placebo response impact outcomes of adult and pediatric ADHD clinical trials? Data from the US Food and Drug Administration 2000-2009. , 2017, Journal of psychiatric research.

[19]  Albert A. Taylor,et al.  Design and analysis of a clinical trial using previous trials as historical control , 2019, Clinical trials.

[20]  J G Ibrahim,et al.  Bayesian Predictive Inference for Time Series Count Data , 2000, Biometrics.

[21]  C. Brensinger,et al.  A meta-analysis of the placebo rates of remission and response in clinical trials of active Crohn's disease. , 2004, Gastroenterology.

[22]  Peter Brocklehurst,et al.  When to keep it simple – adaptive designs are not always useful , 2019, BMC Medicine.

[23]  J. Cummings,et al.  Lessons Learned from Alzheimer Disease: Clinical Trials with Negative Outcomes , 2017, Clinical and translational science.

[24]  D. Asch,et al.  Physicians’ preferences for active-controlled versus placebo-controlled trials of new antihypertensive drugs , 2002, Journal of General Internal Medicine.

[25]  T. Kaptchuk,et al.  Catechol-O-Methyltransferase moderates effect of stress mindset on affect and cognition , 2018, PloS one.

[26]  D. Spiegelhalter,et al.  Summarizing historical information on controls in clinical trials , 2010, Clinical trials.

[27]  Anthony O'Hagan,et al.  Robust meta‐analytic‐predictive priors in clinical trials with historical control information , 2014, Biometrics.

[28]  T. Furukawa,et al.  Is placebo response in antidepressant trials rising or not? A reanalysis of datasets to conclude this long-lasting controversy , 2018, Evidence Based Journals.

[29]  C. Rand,et al.  Randomized trial of the effect of drug presentation on asthma outcomes: the American Lung Association Asthma Clinical Research Centers. , 2009, The Journal of allergy and clinical immunology.

[30]  Michael Branson,et al.  A note on the power prior , 2009, Statistics in medicine.

[31]  Roger B. Davis,et al.  Polymorphisms in Catechol-O-Methyltransferase Modify Treatment Effects of Aspirin on Risk of Cardiovascular Disease , 2014, Arteriosclerosis, thrombosis, and vascular biology.

[32]  S. Basu,et al.  Detecting Anomalies Among Practice Sites Within Multicenter Trials: An Application of Transportability Methods to the TOPCAT and ACCORD BP Trials , 2019, Circulation. Cardiovascular quality and outcomes.

[33]  K. Wiech,et al.  The Effect of Treatment History on Therapeutic Outcome: Psychological and Neurobiological Underpinnings , 2014, PloS one.

[34]  D P Byar,et al.  Design considerations for AIDS trials. , 1990, The New England journal of medicine.

[35]  J. Lieberman,et al.  Placebo response in antipsychotic clinical trials: a meta-analysis. , 2014, JAMA psychiatry.

[36]  Blair T. Johnson,et al.  Initial Severity and Antidepressant Benefits: A Meta-Analysis of Data Submitted to the Food and Drug Administration , 2008, PLoS medicine.

[37]  W Greg Miller,et al.  Current practices and challenges in the standardization and harmonization of clinical laboratory tests. , 2016, The American journal of clinical nutrition.

[38]  W. Brown,et al.  Magnitude and Pattern of Placebo Response in Clinical Trials of Oral Antihyperglycemic Agents: Data From the U.S. Food and Drug Administration, 1999–2015 , 2018, Diabetes Care.

[39]  Blair H. Smith,et al.  Neuropathic pain clinical trials: factors associated with decreases in estimated drug efficacy , 2018, Pain.

[40]  J. Saul,et al.  Genetic variation in catechol-O-methyltransferase modifies effects of clonidine treatment in chronic fatigue syndrome , 2016, The Pharmacogenomics Journal.

[41]  F. Benedetti,et al.  Neuropharmacological Dissection of Placebo Analgesia: Expectation-Activated Opioid Systems versus Conditioning-Activated Specific Subsystems , 1999, The Journal of Neuroscience.

[42]  Tor D. Wager,et al.  Placebo Effects on the Neurologic Pain Signature: A Meta-analysis of Individual Participant Functional Magnetic Resonance Imaging Data , 2018, JAMA neurology.

[43]  S. Elmore,et al.  Proceedings of the 2019 National Toxicology Program Satellite Symposium , 2019, Toxicologic pathology.

[44]  K. Swedberg,et al.  Effects of oral tolvaptan in patients hospitalized for worsening heart failure: the EVEREST Outcome Trial. , 2007, JAMA.

[45]  M. Rowbotham,et al.  Considerations for improving assay sensitivity in chronic pain clinical trials: IMMPACT recommendations , 2012, PAIN.

[46]  R. Wise,et al.  The American Lung Association: Asthma Clinical Research Centers network: addressing real life questions in asthma management , 2014 .

[47]  J. Geddes,et al.  60 years of placebo-controlled antipsychotic drug trials in acute schizophrenia: systematic review, Bayesian meta-analysis and meta-regression of efficacy predictors , 2017 .

[48]  Fabrizio Benedetti,et al.  Response expectancies in placebo analgesia and their clinical relevance , 2001, Pain.

[49]  Vesna Sossi,et al.  Effects of expectation on placebo-induced dopamine release in Parkinson disease. , 2010, Archives of general psychiatry.

[50]  Fang Chen,et al.  Use of historical control data for assessing treatment effects in clinical trials , 2014, Pharmaceutical statistics.

[51]  M. Hummer,et al.  Dropout rates in placebo-controlled and active-control clinical trials of antipsychotic drugs: a meta-analysis. , 2005, Archives of general psychiatry.

[52]  F. Benedetti,et al.  Potentiation of placebo analgesia by proglumide , 1995, The Lancet.

[53]  P. Enck,et al.  Does Sex/Gender Play a Role in Placebo and Nocebo Effects? Conflicting Evidence From Clinical Trials and Experimental Studies , 2019, Front. Neurosci..

[54]  H. Fields,et al.  Analgesic responses to morphine and placebo in individuals with postoperative pain , 1981, PAIN.

[55]  M. Rowbotham,et al.  Effect of variability in the 7-day baseline pain diary on the assay sensitivity of neuropathic pain randomized clinical trials: An ACTTION study , 2014, PAIN®.

[56]  Brian P Hobbs,et al.  Adaptive adjustment of the randomization ratio using historical control data , 2013, Clinical trials.

[57]  N W Galwey,et al.  Supplementation of a clinical trial by historical control data: is the prospect of dynamic borrowing an illusion? , 2017, Statistics in medicine.

[58]  Daniel W. Jones,et al.  Blood Pressure Assessment in Adults in Clinical Practice and Clinic-Based Research: JACC Scientific Expert Panel. , 2019, Journal of the American College of Cardiology.

[59]  W. Brown,et al.  Does the rising placebo response impact antihypertensive clinical trial outcomes? An analysis of data from the Food and Drug Administration 1990-2016 , 2018, PloS one.

[60]  P. Yin,et al.  Sharing Historical Trial Data to Accelerate Clinical Development , 2019, Clinical pharmacology and therapeutics.

[61]  M. Rawlins De testimonio: on the evidence for decisions about the use of therapeutic interventions , 2008, The Lancet.

[62]  A J Dowson,et al.  Unbalanced Randomization Influences Placebo Response: Scientific Versus Ethical Issues Around the Use of Placebo in Migraine Trials , 1999, Cephalalgia : an international journal of headache.

[63]  G. Bennett,et al.  Increasing placebo responses over time in U.S. clinical trials of neuropathic pain , 2015, Pain.

[64]  S. Montella,et al.  Mechanisms of low back pain: a guide for diagnosis and therapy , 2016, F1000Research.

[65]  W. Brown,et al.  Antidepressant–placebo differences in 16 clinical trials over 10 years at a single site: role of baseline severity , 2011, Psychopharmacology.

[66]  Alan Yoshioka Use of randomisation in the Medical Research Council's clinical trial of streptomycin in pulmonary tuberculosis in the 1940s , 1998, BMJ.

[67]  R. Cuffe The inclusion of historical control data may reduce the power of a confirmatory study , 2011, Statistics in medicine.

[68]  D. Price,et al.  Predictors of the placebo analgesia response in randomized controlled trials of chronic pain: a meta-analysis of the individual data from nine industrially sponsored trials , 2015, Pain.

[69]  Erin Kendall Braun,et al.  Mind matters: Placebo enhances reward learning in Parkinson’s disease , 2014, Nature Neuroscience.

[70]  R. Tiwari,et al.  Propensity score matched augmented controls in randomized clinical trials: A case study , 2018, Pharmaceutical statistics.

[71]  M. Ingvar,et al.  Lower Placebo Responses After Long-Term Exposure to Fibromyalgia Pain. , 2017, The journal of pain : official journal of the American Pain Society.

[72]  D. Moerman Ulcers, Anxiety, and Blood Pressure , 2016 .

[73]  Joseph G Ibrahim,et al.  A practical Bayesian adaptive design incorporating data from historical controls , 2018, Statistics in medicine.

[74]  Fabrizio Benedetti,et al.  A systematic review of adverse events in placebo groups of anti-migraine clinical trials , 2009, PAIN.

[75]  Luke J. Chang,et al.  Brain Mechanisms of the Placebo Effect: An Affective Appraisal Account. , 2017, Annual review of clinical psychology.

[76]  E. Silverman,et al.  Pharmacogenomics and Placebo Response in a Randomized Clinical Trial in Asthma , 2019, Clinical pharmacology and therapeutics.

[77]  Jessica Gerber,et al.  Enhancing treatment of osteoarthritis knee pain by boosting expectancy: A functional neuroimaging study , 2018, NeuroImage: Clinical.

[78]  T. Kaptchuk,et al.  Factors Associated With Response to Placebo in Patients With Irritable Bowel Syndrome and Constipation , 2018, Clinical gastroenterology and hepatology : the official clinical practice journal of the American Gastroenterological Association.

[79]  N. D’Esopo,et al.  STREPTOMYCIN TREATMENT OF PULMONARY TUBERCULOSIS , 1998, The Journal of clinical investigation.

[80]  David S. Miller,et al.  Alzheimer’s disease progression by geographical region in a clinical trial setting , 2015, Alzheimer's Research & Therapy.

[81]  J. Kragstrup,et al.  Placebo-Controlled Discontinuation of Long-Term Acid-Suppressant Therapy: A Randomised Trial in General Practice , 2015, International journal of family medicine.

[82]  J. Loscalzo,et al.  Drug‐Placebo Additivity in Randomized Clinical Trials , 2019, Clinical pharmacology and therapeutics.

[83]  J. Zubieta,et al.  Salience Network Functional Connectivity Predicts Placebo Effects in Major Depression. , 2016, Biological psychiatry. Cognitive neuroscience and neuroimaging.

[84]  G. Todd Streptomycin Treatment of Pulmonary Tuberculosis , 1948 .

[85]  A. Zinsmeister,et al.  Predictors of the placebo response in functional dyspepsia , 2006, Alimentary pharmacology & therapeutics.

[86]  J. Loscalzo,et al.  Systems pharmacogenomics - gene, disease, drug and placebo interactions: a case study in COMT. , 2019, Pharmacogenomics.

[87]  W. Brown,et al.  Has the rising placebo response impacted antidepressant clinical trial outcome? Data from the US Food and Drug Administration 1987‐2013 , 2017, World psychiatry : official journal of the World Psychiatric Association.

[88]  M. Rawlins,et al.  De Testimonio: on the evidence for decisions about the use of therapeutic interventions. , 2008, Clinical medicine.

[89]  R. Gollub,et al.  Placebo Responses in Genetically Determined Intellectual Disability: A Meta-Analysis , 2015, PloS one.

[90]  M. Irizarry,et al.  Predictors of Placebo Response in Pooled Lamotrigine Neuropathic Pain Clinical Trials , 2009, The Clinical journal of pain.

[91]  F. Schmidt Meta-Analysis , 2008 .

[92]  F. Benedetti,et al.  Placebo analgesia induced by social observational learning , 2009, PAIN®.

[93]  S. Shen-Orr,et al.  Activation of the reward system boosts innate and adaptive immunity , 2016, Nature Medicine.

[94]  Maurizio Fava,et al.  Does the probability of receiving placebo influence clinical trial outcome? A meta-regression of double-blind, randomized clinical trials in MDD , 2009, European Neuropsychopharmacology.

[95]  B. Horta,et al.  The worldwide prevalence of ADHD: a systematic review and metaregression analysis. , 2007, The American journal of psychiatry.

[96]  Michelle B. Leavy,et al.  Development of Harmonized Outcome Measures for Use in Patient Registries and Clinical Practice: Methods and Lessons Learned , 2019 .

[97]  J. Gerring A case study , 2011, Technology and Society.

[98]  A. Feinstein Clinimetric perspectives. , 1987, Journal of chronic diseases.

[99]  J. Bland,et al.  A Systems Medicine Approach: Translating Emerging Science into Individualized Wellness , 2017, Advances in medicine.

[100]  M. Delgado-Rodríguez,et al.  Systematic review and meta-analysis. , 2017, Medicina intensiva.

[101]  S. Lindborg,et al.  Covariate‐adjusted borrowing of historical control data in randomized clinical trials , 2017, Pharmaceutical statistics.

[102]  Yvette van Norden,et al.  Including historical data in the analysis of clinical trials: Is it worth the effort? , 2017, Statistical methods in medical research.

[103]  M. Benninga,et al.  The Placebo Response in Pediatric Abdominal Pain‐Related Functional Gastrointestinal Disorders: A Systematic Review and Meta‐Analysis , 2017, The Journal of pediatrics.

[104]  P. Enck,et al.  Age and Sex as Moderators of the Placebo Response - An Evaluation of Systematic Reviews and Meta-Analyses across Medicine , 2014, Gerontology.

[105]  Thalia Shoshana Field,et al.  Who says “no” to participating in stroke clinical trials and why: an observational study from the Vancouver Stroke Program , 2019, Trials.

[106]  J. Loscalzo,et al.  Pharmacogenomics and the Placebo Response. , 2018, ACS Chemical Neuroscience.

[107]  R. C. Macridis A review , 1963 .

[108]  P. Enck,et al.  Placebo effects in children: a review , 2013, Pediatric Research.

[109]  Phil Woodward,et al.  Minimizing Patient Burden Through the Use of Historical Subject-Level Data in Innovative Confirmatory Clinical Trials: Review of Methods and Opportunities , 2018, Therapeutic innovation & regulatory science.

[110]  Emmanuel Lesaffre,et al.  Modified power prior with multiple historical trials for binary endpoints , 2018, Statistics in medicine.