Bridging the gap between best evidence and best practice in mental health.

Clinical psychology is in a unique position to move beyond a simplistic agenda of outcome assessment to translating that information into a sustainable model of evidence-based practice. The scientist-practitioner model is no longer limited to use of evidence-based treatments in practice, but can extend to using innovative methodologies to assess rates of recovery, monitor patient progress, intervene in the face of poor response, and contribute to the benchmarking of risk-adjusted outcomes. As the scientific conversation about outcomes moves to encompass feedback of information in order to refine management and practice; researchers, policy-makers, clinicians and patients are poised to look further than average group effects. A new emphasis on individual outcome, taking account of clinical characteristics and risk variables, has generated a clinical outcomes agenda that may be directly translated from "bench to bedside". The current paper addresses the status of evidence-based treatments, measurement of change, patient-focused research and the public availability of risk-adjusted outcomes data; as well as challenges that remain.

[1]  S. Fields,et al.  Essentials of Outcome Assessment , 2002 .

[2]  M. Barkham,et al.  Service profiling and outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies. Clinical Outcomes in Routine Evaluation-Outcome Measures. , 2001, Journal of consulting and clinical psychology.

[3]  S D Imber,et al.  National Institute of Mental Health Treatment of Depression Collaborative Research Program. General effectiveness of treatments. , 1989, Archives of general psychiatry.

[4]  B. Wolman,et al.  Handbook of clinical psychology , 1965 .

[5]  M. Lambert,et al.  Clinical significance of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data. , 1995, Journal of consulting and clinical psychology.

[6]  Larry E. Beutler,et al.  Psychotherapy Research: An International Review of Programmatic Studies , 1991 .

[7]  G. Hardy,et al.  Patterns of change in psychotherapy: An investigation of sudden gains in cognitive therapy using the assimilation model , 2009, Psychotherapy research : journal of the Society for Psychotherapy Research.

[8]  G. Stricker.  The scientist-practitioner model. Gandhi was right again. , 2000, The American psychologist.

[9]  J. Grimshaw,et al.  From best evidence to best practice: effective implementation of change in patients' care , 2003, The Lancet.

[10]  G. Wilson.  Manual-based treatments: the clinical application of research findings. , 1996, Behaviour research and therapy.

[11]  Z. Martinovich,et al.  A phase model of psychotherapy outcome: causal mediation of change. , 1993, Journal of consulting and clinical psychology.

[12]  M. Barkham,et al.  Bridging evidence‐based practice and practice‐based evidence: developing a rigorous and relevant knowledge for the psychological therapies , 2003 .

[13]  E. Hawkins,et al.  Improving outcomes for poorly responding clients: the use of clinical support tools and feedback to clients. , 2005, Journal of clinical psychology.

[14]  A. Page,et al.  Progress monitoring and feedback in psychiatric care reduces depressive symptoms. , 2010, Journal of affective disorders.

[15]  D. Turk,et al.  "Everyone has won and all must have prizes". , 2000, The Clinical journal of pain.

[16]  S. Lilienfeld.  Psychological Treatments That Cause Harm , 2007, Perspectives on psychological science : a journal of the Association for Psychological Science.

[17]  D. Schulte,et al.  Empirically and clinically useful decision making in psychotherapy: differential predictions with treatment response models. , 2006, Psychological assessment.

[18]  G. Andrews.  A Focus on Empirically Supported Outcomes: A Commentary on Search for Empirically Supported Treatments , 2006 .

[19]  W. Stiles,et al.  Predicting change for individual psychotherapy clients on the basis of their nearest neighbors. , 2005, Journal of consulting and clinical psychology.

[20]  Sarah Wild,et al.  Improving access to psychological therapies , 2007 .

[21]  M. Wierzbicki,et al.  A meta-analysis of psychotherapy dropout. , 1993 .

[22]  S. Wessely,et al.  Psychological treatment outcomes in routine NHS services: a commentary on Stiles et al. (2007) , 2007, Psychological Medicine.

[23]  A. Page,et al.  Evaluating the clinical significance of responses by psychiatric inpatients to the mental health subscales of the SF-36. , 2007, Journal of affective disorders.

[24]  M. Krause,et al.  The dose-effect relationship in psychotherapy. , 1986, The American psychologist.

[25]  Richard Layard,et al.  Improving access to psychological therapy: Initial evaluation of two UK demonstration sites , 2009, Behaviour research and therapy.

[26]  Clinically significant change: Jacobson and Truax (1991) revisited. , 1992 .

[27]  M. Hersen,et al.  Effective brief therapies : a clinician's guide , 2000 .

[28]  B. Ogles,et al.  Clinical significance: history, application, and current practice. , 2001, Clinical psychology review.

[29]  N. Abeles,et al.  Client satisfaction, clinical significance, and meaningful change in psychotherapy. , 1993 .

[30]  L. Iezzoni.  Risk Adjustment for Measuring Healthcare Outcomes , 1994 .

[31]  L. Schacht,et al.  Recent applications of risk adjustment for performance measures used by state inpatient psychiatric facilities. , 2003, Harvard review of psychiatry.

[32]  J. Persons.  Psychotherapists Collect Data During Routine Clinical Work That Can Contribute to Knowledge About Mechanisms of Change in Psychotherapy , 2007 .

[33]  R. Tingey,et al.  Assessing clinical significance: proposed extensions to method. , 1996, Psychotherapy research : journal of the Society for Psychotherapy Research.

[34]  J. Pirkis,et al.  Evaluating the access to allied psychological services component of the better outcomes in mental health care program: sixth interim evaluation report: progressive achievements over time , 2005 .

[35]  R. Hill,et al.  Do early responders to psychotherapy maintain treatment gains? , 2002, Journal of clinical psychology.

[36]  S. Hollon,et al.  Defining empirically supported therapies. , 1998, Journal of consulting and clinical psychology.

[37]  A. Nezu,et al.  Evidence-based outcome research: a practical guide to conducting randomized controlled trials for psychosocial interventions , 2007 .

[38]  A. Page,et al.  Clinical Psychology for Trainees: Foundations of Science-Informed Practice , 2006 .

[39]  A. Page,et al.  Measuring Mental Health Outcomes in a Private Psychiatric Clinic: Health of the Nation Outcome Scales and Medical Outcomes Short Form SF-36 , 2001, The Australian and New Zealand journal of psychiatry.

[40]  John C. Norcross,et al.  Handbook of Psychotherapy Integration , 1993 .

[41]  G. Burlingame,et al.  The Effects of a Feedback Intervention on Group Process and Outcome , 2008 .

[42]  R. Hill,et al.  Predicting counseling center clients' response to counseling: A 1-year follow-up , 2001 .

[43]  D. Westen,et al.  A multidimensional meta-analysis of treatments for depression, panic, and generalized anxiety disorder: an empirical examination of the status of empirically supported therapies. , 2001, Journal of consulting and clinical psychology.

[44]  S. Baldwin,et al.  Some Observations on Studying Therapists Instead of Treatment Packages , 2009 .

[45]  E. Forman,et al.  The Psychotherapy Dose‐Response Effect and Its Implications for Treatment Delivery Services , 2006 .

[46]  S. Mason,et al.  A randomised controlled trial to assess the effectiveness of providing self-help information to people with symptoms of acute stress disorder following a traumatic injury. , 2007, Behaviour research and therapy.

[47]  David H. Barlow,et al.  The Scientist Practitioner: Research and Accountability in Clinical and Educational Settings , 1983 .

[48]  Andy P. Field,et al.  Discovering Statistics Using SPSS , 2000 .

[49]  B. Ogles,et al.  A multiperspective, multivariable evaluation of reliable change. , 1998, Journal of consulting and clinical psychology.

[50]  W. Stiles,et al.  Effectiveness of cognitive-behavioural, person-centred, and psychodynamic therapies in UK primary-care routine practice: replication in a larger sample , 2007, Psychological Medicine.

[51]  W. Stiles,et al.  Effectiveness of cognitive-behavioural, person-centred and psychodynamic therapies as practised in UK National Health Service settings , 2006, Psychological Medicine.

[52]  W. Kuyken.  Cognitive therapy outcome: the effects of hopelessness in a naturalistic outcome study. , 2004, Behaviour research and therapy.

[53]  M Schumacher,et al.  Analysis of randomized and nonrandomized patients in clinical trials using the comprehensive cohort follow-up study design. , 1992, Controlled clinical trials.

[54]  M. Lambert,et al.  A survival analysis of clinically significant change in outpatient psychotherapy. , 2001, Journal of clinical psychology.

[55]  Peter Fonagy,et al.  What works for whom? A critical review of psychotherapy research. Second Edition. , 1996 .

[56]  A. Consoli,et al.  Systematic Treatment Selection and Prescriptive Psychotherapy. , 2005 .

[57]  D. Faust,et al.  Leading researchers' consensus on psychotherapy research findings: Implications for the teaching and conduct of psychotherapy , 2003 .

[58]  W. Lutz,et al.  The probability of treatment success, failure and duration—what can be learned from empirical data to support decision making in clinical practice? , 2006 .

[59]  A. Page,et al.  Client-Focused Research: New Directions in Outcome Assessment , 2007, Behaviour Change.

[60]  D. Schulte,et al.  What to Do When Manuals Fail? The Dual Model of Psychotherapy , 2006 .

[61]  S. L. Nielsen,et al.  Improving the effects of psychotherapy: The use of early identification of treatment and problem-solving strategies in routine practice. , 2003 .

[62]  R. Gallop,et al.  Sudden gains in the treatment of generalized anxiety disorder. , 2008, Journal of clinical psychology.

[63]  T. Eells,et al.  The quality of psychotherapy case formulations: a comparison of expert, experienced, and novice cognitive-behavioral and psychodynamic therapists. , 2005, Journal of consulting and clinical psychology.

[64]  Gerald L. Stone,et al.  Thinking About Mental Health Policy in University and College Counseling Centers , 1996 .

[65]  W. Grove,et al.  Clinical versus mechanical prediction: a meta-analysis. , 2000, Psychological assessment.

[66]  T. Baker,et al.  Current Status and Future Prospects of Clinical Psychology , 2008, Psychological science in the public interest : a journal of the American Psychological Society.

[67]  M. Barkham,et al.  Balancing rigour and relevance in guideline development for depression: the case for comprehensive cohort studies. , 2008, Psychology and psychotherapy.

[68]  S. L. Nielsen,et al.  Waiting for supershrink: an empirical analysis of therapist effects , 2003 .

[69]  J K Wing,et al.  Health of the Nation Outcome Scales (HoNOS) , 1998, British Journal of Psychiatry.

[70]  Richard Evans,et al.  Developing the resources and management support for routine evaluation in counselling and psychological therapy service provision: Reflections on a decade of CORE development , 2006 .

[71]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[72]  S. Hayes,et al.  The Scientist Practitioner: Research and Accountability in the Age of Managed Care , 1999 .

[73]  N. Jacobson,et al.  Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. , 1991, Journal of consulting and clinical psychology.

[74]  A. Kazdin.  Evidence-based treatments and delivery of psychological services: Shifting our emphases to increase impact. , 2008 .

[75]  C. Goodheart.  Evidence, Endeavor, and Expertise in Psychology Practice. , 2006 .

[76]  S. Hugonnet,et al.  Effectiveness of a hospital-wide programme to improve compliance with hand hygiene , 2000, The Lancet.

[77]  P. Meehl.  Philosophy of Science: Help or Hindrance? , 1993 .

[78]  S. L. Nielsen,et al.  The Effects of Providing Therapists With Feedback on Patient Progress During Psychotherapy: Are Outcomes Enhanced? , 2001, Psychotherapy research : journal of the Society for Psychotherapy Research.

[79]  S. Schwartz,et al.  Conducting Psychological Research in Medical Settings: Challenges, Limitations, and Recommendations for Effectiveness Research , 2004 .

[80]  R. DeRubeis,et al.  Empirically supported individual and group psychological treatments for adult mental disorders. , 1998, Journal of consulting and clinical psychology.

[81]  E. Hawkins,et al.  The therapeutic effects of providing patient progress information to therapists and patients , 2004 .

[82]  R. Sternberg,et al.  Evidence-based psychotherapy: Where practice and research meet. , 2006 .

[83]  M. Barkham,et al.  A core approach to practice-based evidence: A brief history of the origins and applications of the CORE-OM and CORE System , 2006 .

[84]  R. Ingram,et al.  Cognitive Processes in Cognitive Therapy: Evaluation of the Mechanisms of Change in the Treatment of Depression , 2007 .

[85]  M. Slade.  What Outcomes to Measure in Routine Mental Health Services, and How to Assess Them: A Systematic Review , 2002, The Australian and New Zealand journal of psychiatry.

[86]  P. Emmelkamp,et al.  Failures in behavior therapy , 1983 .

[87]  J. Sapyta,et al.  Feedback to clinicians: theory, research, and practice. , 2005, Journal of clinical psychology.

[88]  L Luborsky,et al.  Comparative studies of psychotherapies: is it true that "everybody has won and all must have prizes"? , 1975, Proceedings of the annual meeting of the American Psychopathological Association.

[89]  W. Lutz.  Efficacy, effectiveness, and expected treatment response in psychotherapy. , 2003, Journal of clinical psychology.

[90]  M. J. Bishop,et al.  Comparison of empirically-derived and rationally-derived methods for identifying patients at risk for treatment failure , 2002 .

[91]  Jack M. Gorman,et al.  A Guide to Treatments That Work , 2007 .

[92]  M. Barkham,et al.  Shapes of early change in psychotherapy under routine outpatient conditions. , 2007, Journal of consulting and clinical psychology.

[93]  M. Lambert,et al.  An Evaluation of the Dose–Response Relationship in Naturalistic Treatment Settings Using Survival Analysis , 2003, Mental health services research.

[94]  L. Hsu.  Reliable changes in psychotherapy: Taking into account regression toward the mean. , 1989 .

[95]  I. Olkin,et al.  Improving the quality of reporting of randomized controlled trials. The CONSORT statement. , 1996, JAMA.

[96]  S. Pilling,et al.  Clinical practice guidelines in clinical psychology and psychotherapy , 2003 .

[97]  W. Kuyken,et al.  The reliability and quality of cognitive case formulation. , 2005, Behaviour research and therapy.

[98]  S. Bauer,et al.  17. Assessing the clinical significance of outcome results , 2008 .

[99]  B. D'avanzo,et al.  Assessing Reliable and Clinically Significant Change on Health of the Nation Outcome Scales: Method for Displaying Longitudinal Data , 2005 .

[100]  R. Krug,et al.  Management of Mental Disorders , 1993 .

[101]  A. Bergin.  Some implications of psychotherapy research for therapeutic practice. , 1966, International journal of psychiatry.

[102]  H. Garb.  Clinical judgment and decision making. , 2005, Annual review of clinical psychology.

[103]  G. L. Paul.  Strategy of outcome research in psychotherapy. , 1967, Journal of consulting psychology.

[104]  S. L. Nielsen,et al.  Enhancing outcome for potential treatment failures: Therapist–client feedback and clinical support tools , 2007 .

[105]  J. Persons,et al.  Mechanisms of action of cognitive therapy: The relative contributions of technical and interpersonal interventions , 1985, Cognitive Therapy and Research.

[106]  A John Rush,et al.  STAR*D: what have we learned? , 2007, The American journal of psychiatry.

[107]  W. Lutz,et al.  Patient profiling : An application of random coefficient regression models to depicting the response of a patient to outpatient psychotherapy , 1999 .

[108]  M. Lieberman,et al.  A study of encounter group casualties. , 1971, Archives of general psychiatry.

[109]  M. Barkham,et al.  Service profiling and Outcomes benchmarking using the CORE-OM: toward practice-based evidence in the psychological therapies : Patient-Focused Research , 2001 .

[110]  C. Clancy,et al.  Outcomes Research: Measuring the End Results of Health Care , 1998, Science.

[111]  C. Petersen.  A Historical Look at Psychology and the Scientist-Practitioner Model , 2007 .

[112]  G. Waller.  Evidence-based treatment and therapist drift. , 2009, Behaviour research and therapy.

[113]  T. Eells,et al.  Generic psychotherapy case formulation training improves formulation quality. , 2007, Psychotherapy.

[114]  Frederick A. Stich,et al.  A meta-analysis of outcome studies comparing bona fide psychotherapies: Empiricially, "all must have prizes." , 1997 .

[115]  C. McHorney,et al.  Individual-patient monitoring in clinical practice: are available health status surveys adequate? , 1995, Quality of Life Research.

[116]  N. Jacobson,et al.  Psychotherapy outcome research: Methods for reporting variability and evaluating clinical significance , 1984 .

[117]  M. Lambert.  Emerging methods for providing clinicians with timely feedback on treatment effectiveness: An introduction , 2005 .

[118]  B. Birmaher,et al.  Rapid response to psychosocial treatment for adolescent depression: a two-year follow-up. , 1998, Journal of the American Academy of Child and Adolescent Psychiatry.

[119]  David Faust,et al.  Research on human judgment and its application to clinical practice. , 1986 .

[120]  Saul Rosenzweig,et al.  Some implicit common factors in diverse methods of psychotherapy. , 1936 .

[121]  G. Mayraz,et al.  Cost-benefit analysis of psychological therapy , 2007, National Institute Economic Review.

[122]  M. Barkham,et al.  Suitability and utility of the CORE–OM and CORE–A for assessing severity of presenting problems in psychological therapy services based in primary and secondary care settings , 2005, British Journal of Psychiatry.

[123]  A. Page,et al.  Monitoring treatment response and outcomes using the World Health Organization's Wellbeing Index in psychiatric care. , 2010, Journal of affective disorders.

[124]  Scott D. Miller,et al.  The partners for change outcome management system. , 2005, Journal of clinical psychology.

[125]  J. Norcross,et al.  Evidence-based practices in mental health : debate and dialogue on the fundamental questions , 2006 .

[126]  R. DeRubeis,et al.  Are Efficacious Laboratory-Validated Treatments Readily Transportable to Clinical Practice? , 2006 .

[127]  Michael J. Lambert,et al.  Introduction to psychotherapy research. , 1991 .

[128]  D. Hawley.  Assessing Change with Preventive Interventions: The Reliable Change Index , 1995 .

[129]  M. Lambert.  Presidential address: What we have learned from a decade of research aimed at improving psychotherapy outcome in routine care , 2007 .

[130]  W. Lutz,et al.  Evaluation of psychotherapy. Efficacy, effectiveness, and patient progress. , 1996, The American psychologist.

[131]  Michael L. Millenson.  Demanding medical excellence , 1997 .

[132]  W. Arrindell,et al.  Establishing clinically significant change: increment of precision and the distinction between individual and group level of analysis. , 1999, Behaviour research and therapy.

[133]  N. Jacobson,et al.  Methods for defining and determining the clinical significance of treatment effects: description, application, and alternatives. , 1999, Journal of consulting and clinical psychology.

[134]  W. Lutz,et al.  Empirically certified treatments or therapists: The issue of separability. , 2007, Psychotherapy.

[135]  W. Stiles,et al.  Time is of the essence: A selective review of the fall and rise of brief therapy research. , 2003, Psychology and psychotherapy.

[136]  George Stricker,et al.  The Scientific Practice of Professional Psychology , 1997 .

[137]  H. Garb.  Judgment research: Implications for clinical practice and testimony in court , 1994 .

[138]  Windy Dryden,et al.  Handbook of Psychotherapy and Behavior Change , 1987, Journal of Cognitive Psychotherapy.

[139]  W. Lutz,et al.  Patterns of early change and their relationship to outcome and follow-up among patients with major depressive disorders. , 2009, Journal of affective disorders.