Defining a clinically meaningful effect for the design and interpretation of randomized controlled trials.

OBJECTIVE This article captures the proceedings of a meeting aimed at defining clinically meaningful effects for use in randomized controlled trials for psychopharmacological agents. DESIGN Experts from a variety of disciplines defined clinically meaningful effects from their perspectives along with viewpoints about how to design and interpret randomized controlled trials. SETTING The article offers relevant, practical, and sometimes anecdotal information about clinically meaningful effects and how to interpret them. PARTICIPANTS The concept for this session was the work of co-chairs Richard Keefe and the late Andy Leon. Faculty included Richard Keefe, PhD; James McNulty, AbScB; Robert S. Epstein, MD, MS; Shelby D. Reed, PhD; Juan Sanchez, MD; Ginger Haynes, PhD; Andrew C. Leon, PhD; Helena Chmura Kraemer, PhD; Ellen Frank, PhD, and Kenneth L. Davis, MD. RESULTS The term clinically meaningful effect is an important aspect of designing and interpreting randomized controlled trials but can be particularly difficult in the setting of psychopharmacology where effect size may be modest, particularly over the short term, because of a strong response to placebo. Payers, regulators, patients, and clinicians have different concerns about clinically meaningful effects and may describe these terms differently. The use of moderators in success rate differences may help better delineate clinically meaningful effects. CONCLUSION There is no clear consensus on a single definition for clinically meaningful differences in randomized controlled trials, and investigators must be sensitive to specific concerns of stakeholders in psychopharmacology in order to design and execute appropriate clinical trials.

[1]  Ellen Frank,et al.  A novel approach for developing and interpreting treatment moderator profiles in randomized clinical trials. , 2013, JAMA psychiatry.

[2]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[3]  R. Baltussen,et al.  Priority setting of health interventions: the need for multi-criteria decision analysis , 2006, Cost effectiveness and resource allocation : C/E.

[4]  P S Appelbaum,et al.  False hopes and best data: consent to research and the therapeutic misconception. , 1987, The Hastings Center report.

[5]  R. Verbrugge,et al.  Impact of Medication Adherence on Hospitalization Risk and Healthcare Cost , 2005, Medical care.

[6]  N. Walsh,et al.  Long‐term outcomes and costs of an integrated rehabilitation program for chronic knee pain: A pragmatic, cluster randomized, controlled trial , 2012, Arthritis care & research.

[7]  D. A. Kenny,et al.  The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. , 1986, Journal of personality and social psychology.

[8]  H. Kraemer,et al.  Predictors and moderators of time to remission of major depression with interpersonal psychotherapy and SSRI pharmacotherapy , 2010, Psychological Medicine.

[9]  W. Gerth,et al.  The Potential Economic Consequences of Cognitive Improvement with Losartan , 2002, Blood pressure.

[10]  J. Vilalta-Franch,et al.  [Effectiveness of donepezil on several cognitive functions in patients with Alzheimer's disease over 12 months]. , 2001, Neurologia.

[11]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[12]  David J. Kupfer,et al.  Size of Treatment Effects and Their Importance to Clinical Research and Practice , 2006, Biological Psychiatry.

[13]  Rory A. Fisher,et al.  The Arrangement of Field Experiments , 1992 .

[14]  L. V. Jones,et al.  A sensible formulation of the significance test. , 2000, Psychological methods.

[15]  A. Leon Comparative effectiveness clinical trials in psychiatry: superiority, noninferiority, and the role of active comparators. , 2011, The Journal of clinical psychiatry.

[16]  M. Albert,et al.  Bridging from clinical endpoints to estimates of treatment value for external decision makers , 2009, The journal of nutrition, health & aging.

[17]  D. Whynes,et al.  The Costs of Treating Breast Cancer in the United Kingdom: Implications for Screening , 1998, International Journal of Technology Assessment in Health Care.

[18]  H. Kraemer,et al.  Simultaneous evaluation of the harms and benefits of treatments in randomized clinical trials: demonstration of a new approach , 2011, Psychological Medicine.

[19]  D J Kupfer,et al.  Three-year outcomes for maintenance therapies in recurrent depression. , 1990, Archives of general psychiatry.

[20]  H. Kraemer,et al.  How to assess the clinical impact of treatments on patients, rather than the statistical impact of treatments on measures , 2011, International journal of methods in psychiatric research.

[21]  M. Weinstein,et al.  Foundations of cost-effectiveness analysis for health and medical practices. , 1977, The New England journal of medicine.

[22]  S. Leucht,et al.  How effective are second-generation antipsychotic drugs? A meta-analysis of placebo-controlled trials , 2009, Molecular Psychiatry.

[23]  R. Epstein,et al.  Interpretation of quality of life changes , 1993, Quality of Life Research.

[24]  A. Jha,et al.  Greater adherence to diabetes drugs is linked to less hospital use and could save nearly $5 billion annually. , 2012, Health affairs.