Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial.

OBJECTIVE A randomized cluster controlled trial tested the hypothesis that weekly feedback to clinicians would improve the effectiveness of home-based mental health treatment received by youths in community settings. METHODS Youths, caregivers, and clinicians at 28 sites in ten states completed assessments of the youths' symptoms and functioning every other week. Clinicians at 13 sites were provided with weekly feedback about the assessments, and clinicians at 15 sites received feedback every 90 days. Data were collected from June 1, 2006, through December 31, 2008. Intent-to-treat analyses were conducted with hierarchical linear modeling of data provided by youths, caregivers, and clinicians. RESULTS Assessments by youths, caregivers, and clinicians indicated that youths (N=173) treated at sites where clinicians could receive weekly feedback improved faster than youths (N=167) treated at sites where clinicians did not receive weekly feedback. A dose-response analysis showed even stronger effects when clinicians viewed more feedback reports. CONCLUSIONS Routine measurement and feedback can be used to improve outcomes for youths who receive typical home-based services in the community.

[1]  J. Levin,et al.  Should providers of treatment be regarded as a random factor? If it ain't broke, don't "fix" it: a comment on Siemer and Joormann (2003). , 2003, Psychological methods.

[2]  L. Bickman.  Why Don’t We Have Effective Mental Health Services? , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[3]  Leonard Bickman,et al.  Change What? Identifying Quality Improvement Targets by Investigating Usual Mental Health Care , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[4]  Donald Hedeker,et al.  Application of random-efiects pattern-mixture models for miss-ing data in longitudinal studies , 1997 .

[5]  R. Goodman,et al.  The extended version of the Strengths and Difficulties Questionnaire as a guide to child psychiatric caseness and consequent burden. , 1999, Journal of child psychology and psychiatry, and allied disciplines.

[6]  Anthony S. Bryk,et al.  Hierarchical Linear Models: Applications and Data Analysis Methods , 1992 .

[7]  J. Kogan,et al.  Use of outcomes information in child mental health treatment: results from a pilot study. , 2010, Psychiatric services.

[8]  J. Weisz,et al.  Applying Treatment Outcome Research in Clinical Practice: Techniques for Adapting Interventions to the Real World. , 2003, Child and adolescent mental health.

[9]  Donald Hedeker,et al.  Estimation of Effect Size From a Series of Experiments Involving Paired Comparisons , 1993 .

[10]  R. J. Reese,et al.  Does a continuous feedback system improve psychotherapy outcome? , 2009, Psychotherapy.

[11]  J. Singer,et al.  Applied Longitudinal Data Analysis , 2003 .

[12]  Jutta Joormann,et al.  Power and measures of effect size in analysis of variance with fixed versus random nested factors. , 2003, Psychological methods.

[13]  B. Ogles,et al.  The influence of outcome measures in assessing client change and treatment decisions. , 2006, Journal of clinical psychology.

[14]  S. Baldwin,et al.  Youth psychotherapy change trajectories and outcomes in usual care: Community mental health versus managed care settings. , 2010, Journal of consulting and clinical psychology.

[15]  Roel Bosker,et al.  Multilevel analysis : an introduction to basic and advanced multilevel modeling , 1999 .

[16]  A. Kazdin,et al.  Rebooting Psychotherapy Research and Practice to Reduce the Burden of Mental Illness , 2011, Perspectives on psychological science : a journal of the Association for Psychological Science.

[17]  T. Becker,et al.  Effect of feedback of treatment outcome in specialist mental healthcare: meta-analysis , 2009, British Journal of Psychiatry.

[18]  Apa Presidential Task Force on Evidence-Based Practice.  Evidence-based practice in psychology. , 2006 .

[19]  A. Page,et al.  Bridging the gap between best evidence and best practice in mental health. , 2010, Clinical psychology review.

[20]  Michael J. Lambert,et al.  "Yes, it is time for clinicians to routinely monitor treatment outcome" , 2010 .

[21]  G. Burlingame,et al.  Change Trajectories for the Youth Outcome Questionnaire Self-Report: Identifying Youth at Risk for Treatment Failure , 2010, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[22]  L. Bickman,et al.  Measuring mental health outcomes with pre-post designs , 2001, The Journal of Behavioral Health Services & Research.

[23]  T. Achenbach.  Integrative Guide for the 1991 CBCL/4-18, Ysr, and Trf Profiles , 1991 .

[24]  Eric L. Daleiden,et al.  Driving with Roadmaps and Dashboards: Using Information Resources to Structure the Decision Models in Service Organizations , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[25]  L. Bickman,et al.  Theories related to changing clinician practice. , 2005, Child and adolescent psychiatric clinics of North America.

[26]  S. H. B. Frantz,et al.  Do we know when our clients get worse? an investigation of therapists' ability to detect negative client change. , 2009, Clinical psychology & psychotherapy.

[27]  K. Carroll,et al.  Now You See It, Now You Don't A Comparison of Traditional Versus Random-Effects Regression Models in the Analysis of Longitudinal Follow-Up Data From a Clinical Trial , 1997 .

[28]  L. Bickman,et al.  Beyond outcomes monitoring: measurement feedback systems in child and adolescent clinical practice , 2009, Current opinion in psychiatry.

[29]  S. Kelley,et al.  Finding the Common Core: Evidence-Based Practices, Clinically Relevant Evidence, and Core Mechanisms of Change , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[30]  Jonathan C. Cox,et al.  Youth Outcome Questionnaire (Y-OQ). , 1999 .

[31]  M. Lambert,et al.  Outcome oriented supervision: Advantages of adding systematic client tracking to supportive consultations , 2007 .