Placebo Response and Practice Effects in Schizophrenia Cognition Trials

Importance Patients’ previous experience with performance-based cognitive tests in clinical trials for cognitive impairment associated with schizophrenia can create practice-related improvements. Placebo-controlled trials for cognitive impairment associated with schizophrenia are at risk for these practice effects, which can be difficult to distinguish from placebo effects. Objectives To conduct a systematic evaluation of the magnitude of practice effects on the Measurement and Treatment Research to Improve Cognition in Schizophrenia Consensus Cognitive Battery (MCCB) in cognitive impairment associated with schizophrenia and to examine which demographic, clinical, and cognitive characteristics were associated with improvement in placebo conditions. Design, Setting, and Participants A blinded review was conducted of data from 813 patients with schizophrenia who were treated with placebo in 12 randomized placebo-controlled clinical trials conducted mostly in outpatient clinics in North America, Europe, Asia, and Latin America from February 22, 2007, to March 1, 2014. A total of 779 patients provided data for the primary outcome measure at baseline and at least 1 follow-up. Seven trials had prebaseline assessments wherein the patients knew that they were not receiving treatment, allowing a comparison of practice and placebo effects in the same patients. Interventions Placebo compared with various experimental drug treatments. Main Outcomes and Measures Composite score on the MCCB. Results Of the 813 patients in the study (260 women and 553 men; mean [SD] age, 41.2 [11.5] years), the mean MCCB composite score at baseline was 22.8 points below the normative mean, and the mean (SEM) total change in the MCCB during receipt of placebo was 1.8 (0.2) T-score points (95% CI, 1.40-2.18), equivalent to a change of 0.18 SD. Practice effects in the 7 studies in which there was a prebaseline assessment were essentially identical to the postbaseline placebo changes. Baseline factors associated with greater improvements in the MCCB during receipt of placebo included more depression/anxiety (F1,438 = 5.41; P = .02), more motivation (F1,272 = 4.63; P = .03), and less improvement from screening to baseline (F1,421 = 59.32; P < .001). Conclusions and Relevance Placebo effects were minimal and associated with the number of postbaseline assessments and several patient characteristics. Given that the patients performed 2.28 SDs below normative standards on average at baseline, a mean placebo-associated improvement of less than 0.2 SD provides evidence that ceiling effects do not occur in these trials. These minimal changes in the MCCB could not be responsible for effective active treatments failing to separate from placebo.

[1]  S. Lawrie,et al.  Bitopertin in Negative Symptoms of Schizophrenia—Results From the Phase III FlashLyte and DayLyte Studies , 2017, Biological Psychiatry.

[2]  E. Dunayevich,et al.  Psychometric characteristics of the MATRICS Consensus Cognitive Battery in a large pooled cohort of stable schizophrenia patients , 2017, Schizophrenia Research.

[3]  M. Ahissar,et al.  Neurophysiological mechanisms of cortical plasticity impairments in schizophrenia and modulation by the NMDA receptor agonist D-serine. , 2016, Brain : a journal of neurology.

[4]  T L Patterson,et al.  UCSD Performance-Based Skills Assessment , 2016 .

[5]  Philip D. Harvey,et al.  A Multicenter, Rater-Blinded, Randomized Controlled Study of Auditory Processing-Focused Cognitive Remediation Combined With Open-Label Lurasidone in Patients With Schizophrenia and Schizoaffective Disorder. , 2016, The Journal of clinical psychiatry.

[6]  A. Othman,et al.  The α7 Nicotinic Agonist ABT-126 in the Treatment of Cognitive Impairment Associated with Schizophrenia in Nonsmokers: Results from a Randomized Controlled Phase 2b Study , 2016, Neuropsychopharmacology.

[7]  A. Othman,et al.  A Randomized Trial to Assess the Efficacy and Safety of ABT-126, a Selective α7 Nicotinic Acetylcholine Receptor Agonist, in the Treatment of Cognitive Impairment in Schizophrenia. , 2016, The American journal of psychiatry.

[8]  O. Wolkowitz,et al.  Neuroscience-informed auditory training in schizophrenia: A final report of the effects on cognition and serum brain-derived neurotrophic factor , 2015, Schizophrenia Research: Cognition.

[9]  D. Hilt,et al.  Randomized, Double-Blind, Placebo-Controlled Study of Encenicline, an α7 Nicotinic Acetylcholine Receptor Agonist, as a Treatment for Cognitive Impairment in Schizophrenia , 2015, Neuropsychopharmacology.

[10]  S. Potkin,et al.  Defining therapeutic benefit for people with schizophrenia: Focus on negative symptoms , 2015, Schizophrenia Research.

[11]  G. Papakostas,et al.  The nature of placebo response in clinical studies of major depressive disorder. , 2015, The Journal of clinical psychiatry.

[12]  Michael F. Green,et al.  The MATRICS consensus cognitive battery: what we know 6 years later. , 2014, The American journal of psychiatry.

[13]  A. Othman,et al.  A randomized trial of the efficacy and safety of the H3 antagonist ABT-288 in cognitive impairment associated with schizophrenia. , 2014, Schizophrenia bulletin.

[14]  M. Ostland,et al.  Effect of bitopertin, a glycine reuptake inhibitor, on negative symptoms of schizophrenia: a randomized, double-blind, proof-of-concept study. , 2014, JAMA psychiatry.

[15]  D. Umbricht,et al.  A Randomized, Placebo-Controlled Study Investigating the Nicotinic α7 Agonist, RG3487, for Cognitive Deficits in Schizophrenia , 2014, Neuropsychopharmacology.

[16]  Michael Pencina,et al.  A repeated measures model for analysis of continuous outcomes in sequential parallel comparison design studies , 2013, Statistics in medicine.

[17]  Michael F. Green,et al.  Effect of the neuroprotective peptide davunetide (AL-108) on cognition and functional capacity in schizophrenia , 2012, Schizophrenia Research.

[18]  R. Buchanan,et al.  Clinical Trials of Potential Cognitive-Enhancing Drugs in Schizophrenia: What Have We Learned So Far? , 2011, Schizophrenia bulletin.

[19]  Michael F. Green,et al.  The FDA-NIMH-MATRICS guidelines for clinical trial design of cognitive-enhancing drugs: what do we know 5 years later? , 2011, Schizophrenia bulletin.

[20]  Anastasia Ivanova,et al.  Optimality, sample size, and power calculations for the sequential parallel comparison design , 2011, Statistics in medicine.

[21]  Vyv Huddy,et al.  A Meta-Analysis of Cognitive Remediation for Schizophrenia: Methodology and Effect Sizes , 2012 .

[22]  Daniel C. Javitt,et al.  A Randomized Clinical Trial of MK-0777 for the Treatment of Cognitive Impairments in People with Schizophrenia , 2011, Biological Psychiatry.

[23]  M. Keshavan,et al.  Effects of Cognitive Enhancement Therapy on Employment Outcomes in Early Schizophrenia: Results From a 2-Year Randomized Trial , 2011, Research on social work practice.

[24]  Philip D. Harvey,et al.  Circumstances Under Which Practice Does Not Make Perfect: A Review of the Practice Effect Literature in Schizophrenia and Its Relevance to Clinical Treatment Studies , 2010, Neuropsychopharmacology.

[25]  Sophia Vinogradov,et al.  Using neuroplasticity-based auditory training to improve verbal memory in schizophrenia. , 2009, The American journal of psychiatry.

[26]  Michael F. Green,et al.  Functional co-primary measures for clinical trials in schizophrenia: results from the MATRICS Psychometric and Standardization Study. , 2008, The American journal of psychiatry.

[27]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 1: test selection, reliability, and validity. , 2008, The American journal of psychiatry.

[28]  Michael F. Green,et al.  The MATRICS Consensus Cognitive Battery, part 2: co-norming and standardization. , 2008, The American journal of psychiatry.

[29]  Michael F. Green,et al.  Neurocognitive effects of antipsychotic medications in patients with chronic schizophrenia in the CATIE Trial. , 2007, Archives of general psychiatry.

[30]  Robert C. Smith,et al.  Effects of Nicotine Nasal Spray on Cognitive Function in Schizophrenia , 2006, Neuropsychopharmacology.

[31]  Philip D. Harvey,et al.  The Brief Assessment of Cognition in Schizophrenia: reliability, sensitivity, and comparison with a standard neurocognitive battery , 2004, Schizophrenia Research.

[32]  J. Lieberman,et al.  Longitudinal assessment of methylphenidate effects on oral word production and symptoms in first-episode schizophrenia at acute and stabilized phases , 1999, Biological Psychiatry.

[33]  S. Marder,et al.  The effects of risperidone on the five dimensions of schizophrenia derived by factor analysis: combined results of the North American trials. , 1997, The Journal of clinical psychiatry.

[34]  G. Hogarty,et al.  Three-year trials of personal therapy among schizophrenic patients living with or independent of family, II: Effects on adjustment of patients. , 1997, The American journal of psychiatry.

[35]  R. Goldman,et al.  Validation of the 16-item Negative Symptom Assessment. , 1993, Journal of psychiatric research.

[36]  P. Zelazo,et al.  Acute alcohol intoxication and cognitive functioning. , 1990, Journal of studies on alcohol.

[37]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[38]  J. Krupnick A Meta-Analysis of Cognitive Remediation for Schizophrenia: Methodology and Effect Sizes , 2012 .

[39]  Michael F. Green,et al.  A summary of the FDA-NIMH-MATRICS workshop on clinical trial design for neurocognitive drugs for schizophrenia. , 2005, Schizophrenia bulletin.

[40]  A. Summerfelt,et al.  The negative symptom assessment: a new instrument to assess negative symptoms of schizophrenia. , 1989, Psychopharmacology bulletin.

[41]  S. Kay,et al.  The positive and negative syndrome scale (PANSS) for schizophrenia. , 1987, Schizophrenia bulletin.