Expertise in psychotherapy: an elusive goal?

It has been argued that psychotherapy is a profession without any expertise (Shanteau, 1992). We examine the validity of this claim, reviewing the literature on expertise, clinical decision making, and psychotherapeutic outcome assessment, and find it a reasonable assessment. There is no demonstration of accuracy and skill that is associated with experience as a therapist. We posit that this absence of an expertise-experience relation is attributable to therapists' lack of access to quality outcome information regarding their interventions and an overreliance on fallible information-processing strategies even when such outcome information is available. The research on providing outcome feedback is reviewed, and although it does relate to client improvement, it has not been shown to be associated with any gains in therapist skill or expertise. We propose a model of outcome information usage and specific a priori hypothesis testing as a means of developing expertise. (PsycINFO Database Record (c) 2014 APA, all rights reserved).

[1]  J. Shanteau.  Competence in experts: The role of task characteristics , 1992 .

[2]  Hans Gruber,et al.  The Role of Experience in Professional Training and Development of Psychological Counsellors , 2004 .

[3]  Mark A. Hubble,et al.  The outcome of psychotherapy: yesterday, today, and tomorrow. , 2013, Psychotherapy.

[4]  M. Wierzbicki.  Issues in Clinical Psychology: Subjective Versus Objective Approaches , 1992 .

[5]  M. Lambert.  Prevention of Treatment Failure: The Use of Measuring, Monitoring, and Feedback in Clinical Practice , 2010 .

[6]  Mark Snyder,et al.  Testing Hypotheses about Other People , 1980 .

[7]  S. L. Nielsen,et al.  A lab test and algorithms for identifying clients at risk for treatment failure. , 2005, Journal of clinical psychology.

[8]  S. Walfish,et al.  An Investigation of Self-Assessment Bias in Mental Health Providers , 2012, Psychological reports.

[9]  D. Faust,et al.  Clinical judgment and decision making in neuropsychology. , 1989, Archives of clinical neuropsychology : the official journal of the National Academy of Neuropsychologists.

[10]  M. Lambert,et al.  Patient-focused research: using patient outcome data to enhance treatment effects. , 2001, Journal of consulting and clinical psychology.

[11]  D. Bolt,et al.  Therapist effects in psychotherapy: A random-effects modeling of the National Institute of Mental Health Treatment of Depression Collaborative Research Program data , 2006 .

[12]  Genna R. Cohen,et al.  The Meta-Analysis of Clinical Judgment Project: Fifty-Six Years of Accumulated Research on Clinical Versus Statistical Prediction , 2006 .

[13]  L. Ross,et al.  Human Inference: Strategies and Shortcomings of Social Judgment. , 1981 .

[14]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[15]  James F. Boswell,et al.  Patient characteristics and variability in adherence and competence in cognitive-behavioral therapy for panic disorder. , 2013, Journal of consulting and clinical psychology.

[16]  J. Hattie,et al.  The Power of Feedback , 2007 .

[17]  B. Wampold,et al.  Uniformity of evidence-based treatments in practice? Therapist effects in the delivery of cognitive processing therapy for PTSD. , 2013, Journal of counseling psychology.

[18]  G N Burrow,et al.  Admission decisions and performance during medical school. , 1981, Journal of medical education.

[19]  Kerri L. Johnson,et al.  Why People Fail to Recognize Their Own Incompetence , 2003 .

[20]  C. Witteman,et al.  Intermediate Effects in Psychodiagnostic Classification , 2007 .

[21]  Michael Barkham,et al.  Developing and Delivering Practice-Based Evidence , 2010 .

[22]  B. Wampold,et al.  Estimating variability in outcomes attributable to therapists: a naturalistic study of outcomes in managed care. , 2005, Journal of consulting and clinical psychology.

[23]  Stephan Lewandowsky,et al.  Expertise: acquisition, limitations, and control , 2009 .

[24]  Arthur C. Bohart,et al.  Clients: The neglected common factor in psychotherapy. , 2010 .

[25]  Edward Brent,et al.  When prophecy bends: The preference–expectation link in U.S. presidential elections, 1952–1980. , 1983 .

[26]  J. Sapyta,et al.  Feedback to clinicians: theory, research, and practice. , 2005, Journal of clinical psychology.

[27]  Ullrich K. H. Ecker,et al.  Misinformation and Its Correction , 2012, Psychological science in the public interest : a journal of the American Psychological Society.

[28]  Beth E. Haverkamp,et al.  Confirmatory bias in hypothesis testing for client-identified and counselor self-generated hypotheses , 1993 .

[29]  H. Arkes,et al.  Impediments to accurate clinical judgment and possible ways to minimize their impact. , 1981, Journal of consulting and clinical psychology.

[30]  P. Ulleberg,et al.  Psychotherapists' self-reports of their interpersonal functioning and difficulties in practice as predictors of patient outcome , 2013, Psychotherapy research : journal of the Society for Psychotherapy Research.

[31]  K. A. Ericsson,et al.  The Influence of Experience and Deliberate Practice on the Development of Superior Expert Performance , 2006 .

[32]  M. Gill,et al.  On the genesis of confidence. , 1998 .

[33]  D. M. Stein,et al.  On the relationship between therapist experience and psychotherapy outcome. , 1984 .

[34]  Zac E. Imel,et al.  Untangling the alliance-outcome correlation: exploring the relative importance of therapist and patient variability in the alliance. , 2007, Journal of consulting and clinical psychology.

[35]  A. Kluger,et al.  The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. , 1996 .

[36]  D. Weiss,et al.  Assessing Diagnostic Expertise of Counselors Using the Cochran-Weiss-Shanteau (CWS) Index , 2012 .

[37]  K. A. Ericsson,et al.  Development of Professional Expertise: Enhancing the Development of Professional Performance: Implications from the Study of Deliberate Practice , 2009 .

[38]  P. Pintrich.  A Motivational Science Perspective on the Role of Student Motivation in Learning and Teaching Contexts. , 2003 .

[39]  Mark A. Hubble,et al.  Supershrinks: What is the secret of their success? , 2008 .

[40]  E. Hawkins,et al.  Providing feedback to psychotherapists on their patients' progress: clinical results and practice suggestions. , 2005, Journal of clinical psychology.

[41]  K. A. Ericsson,et al.  Expert and exceptional performance: evidence of maximal adaptation to task constraints. , 1996, Annual review of psychology.

[42]  Richard L. Wiener,et al.  Evaluation, diagnosis, and prediction in parole decision making. , 1982 .

[43]  Michael J. Prietula,et al.  Studies of Expertise from Psychological Perspectives , 2006 .

[44]  H. Strupp,et al.  Specific vs nonspecific factors in psychotherapy. A controlled study of outcome. , 1979, Archives of general psychiatry.

[45]  W. Lutz,et al.  Evaluation of psychotherapy. Efficacy, effectiveness, and patient progress. , 1996, The American psychologist.

[46]  Bruce E. Wampold,et al.  The heart and soul of change: Delivering what works in therapy, 2nd ed. , 2010 .

[47]  Robin L. Cautin,et al.  Why many clinical psychologists are resistant to evidence-based practice: root causes and constructive remedies. , 2013, Clinical psychology review.

[48]  Timothy A. Post,et al.  On the solving of ill-structured problems. , 1988 .

[49]  Timothy A. Post,et al.  Problem-Solving Skill in the Social Sciences , 1983 .

[50]  D. M. Stein,et al.  Graduate Training in Psychotherapy: Are Therapy Outcomes Enhanced?. , 1995 .

[51]  J. Lichtenberg.  Comment Effects of Experience on Judgment Accuracy , 2009 .

[52]  Genna R. Cohen,et al.  The Meta-Analysis of Clinical Judgment Project , 2009 .

[53]  Michael Barkham,et al.  Patterns of therapist variability: therapist effects and the contribution of patient severity and risk. , 2012, Journal of consulting and clinical psychology.

[54]  D. Kahneman,et al.  Conditions for intuitive expertise: a failure to disagree. , 2009, The American psychologist.

[55]  H. Garb,et al.  Clinical judgment, clinical training, and professional experience. , 1989, Psychological bulletin.

[56]  M. Davies.  Confirmatory bias in the evaluation of personality descriptions: positive test strategies and output interference. , 2003, Journal of personality and social psychology.

[57]  M. Goldfried,et al.  Predicting the effect of cognitive therapy for depression: a study of unique and common factors. , 1996, Journal of consulting and clinical psychology.

[58]  Some considerations relative to nondirective counseling as therapy. , 1948 .

[59]  Stuart Oskamp,et al.  The relationship of clinical experience and training methods to several criteria of clinical prediction. , 1962 .

[60]  Follies subdued: Informational efficiency under adaptive expectations and confirmatory bias , 2011 .

[61]  B. Fischhoff,et al.  Hindsight is not equal to foresight: The effect of outcome knowledge on judgment under uncertainty. , 1975 .

[62]  Paul E. Meehl,et al.  Wanted—a good cook-book. , 1956 .

[63]  M. Chi.  Two Approaches to the Study of Experts' Characteristics , 2006 .

[64]  S. L. Nielsen,et al.  Waiting for supershrink: an empirical analysis of therapist effects , 2003 .

[65]  F. Dumont.  Expertise in psychotherapy: Inherent liabilities of becoming experienced. , 1991 .

[66]  M. Lambert,et al.  Collecting client feedback. , 2011, Psychotherapy.

[67]  R. DeRubeis,et al.  Therapist adherence/competence and treatment outcome: A meta-analytic review. , 2010, Journal of consulting and clinical psychology.

[68]  A. Beck,et al.  Meta‐Analysis of Therapist Effects in Psychotherapy Outcome Studies , 1991 .

[69]  N. Jacobson,et al.  Testing the integrity of a psychotherapy protocol: assessment of adherence and competence. , 1993, Journal of consulting and clinical psychology.

[70]  S. Woods,et al.  Therapists, therapist variables, and cognitive-behavioral therapy outcome in a multicenter trial for panic disorder. , 2001, Journal of consulting and clinical psychology.

[71]  B. Wampold.  Contextualizing psychotherapy as a healing practice: Culture, history, and methods , 2001 .

[72]  S. Phillips,et al.  Preventing anchoring errors in clinical judgment. , 1984, Journal of consulting and clinical psychology.

[73]  H. Rogers,et al.  Comparative effectiveness of professional and paraprofessional helpers. , 1984, Psychological bulletin.

[74]  Mark A. Hubble,et al.  Outcome-informed clinical work. , 2005 .

[75]  J. Bransford,et al.  The study of clinical judgment: an ecological approach , 1987 .

[76]  H. Strupp,et al.  Effects of training in time-limited dynamic psychotherapy: changes in therapist behavior. , 1993, Journal of consulting and clinical psychology.

[77]  David Faust,et al.  Eliminating the hindsight bias. , 1988 .

[78]  H. Garb.  Studying the Clinician: Judgment Research and Psychological Assessment , 1998 .

[79]  L. Beutler,et al.  Client Characteristics and Psychotherapy: Perspectives, Support, Interactions, and Implications for Training , 2001 .

[80]  L. R. Goldberg.  Simple models or simple processes? Some research on clinical judgments. , 1968, The American psychologist.

[81]  Scott D. Miller,et al.  The partners for change outcome management system. , 2005, Journal of clinical psychology.

[82]  A. Greenwald,et al.  Under what conditions does theory obstruct research progress? , 1986, Psychological review.

[83]  M. Lambert,et al.  Enhancing treatment outcome of patients at risk of treatment failure: meta-analytic and mega-analytic review of a psychotherapy quality assurance system. , 2010, Journal of consulting and clinical psychology.

[84]  L. R. Goldberg,et al.  The effectiveness of clinicians' judgments; the diagnosis of organic brain damage from the Bender-Gestalt test. , 1959, Journal of consulting psychology.

[85]  M. Lambert,et al.  Therapist effects: facilitative interpersonal skills as a predictor of therapist success. , 2009, Journal of clinical psychology.

[86]  B. Wampold,et al.  Expanding the lens of evidence-based practice in psychotherapy: a common factors perspective. , 2014, Psychotherapy.

[87]  B. Wampold.  The Great Psychotherapy Debate: Models, Methods, and Findings , 2001 .

[88]  P. Boyle,et al.  Understanding why some clinicians use pseudoscientific methods: Findings from research on clinical judgment. , 2003 .

[89]  S. Oskamp.  OVERCONFIDENCE IN CASE-STUDY JUDGMENTS. , 1965, Journal of consulting psychology.

[90]  B. Wampold,et al.  Benchmarking the effectiveness of psychotherapy treatment for adult depression in a managed care environment: a preliminary study. , 2008, Journal of consulting and clinical psychology.

[91]  H. Arkes,et al.  Hindsight bias among physicians weighing the likelihood of diagnoses. , 1981, The Journal of applied psychology.

[92]  D. Sackett.  Evidence-based medicine: how to practice and teach EBM: 2nd ed , 2000 .

[93]  John S. Lyons,et al.  Therapist Effects in Outpatient Psychotherapy: A Three-Level Growth Curve Approach , 2007 .

[94]  Stephanie L. Budge,et al.  Differences among trainees in client outcomes associated with the phase model of change. , 2013, Psychotherapy.

[95]  Peter Fischer,et al.  Selective exposure to information: how different modes of decision making affect subsequent confirmatory information processing. , 2010, The British journal of social psychology.

[96]  L. Beutler.  The Psychotherapist as a Neglected Variable in Psychotherapy: An Illustration by Reference to the Role of Therapist Experience and Training , 1997 .

[97]  H. Garb.  Clinical judgment and decision making. , 2005, Annual review of clinical psychology.

[98]  J. Kruger,et al.  Journal of Personality and Social Psychology The Hobgoblin of Consistency : Algorithmic Judgment Strategies Underlie Inflated Self-Assessments of Performance , 2013 .

[99]  Victoria A. Shivy,et al.  Information processing strategies in counselor hypothesis testing: The role of selective memory and expectancy. , 1990 .

[100]  Fernand Gobet,et al.  Deliberate Practice , 2011 .

[101]  M. L. Smith,et al.  Meta-analysis of psychotherapy outcome studies. , 1977, The American psychologist.

[102]  R. Devaul,et al.  Medical school performance of initially rejected students. , 1987, JAMA.

[103]  S. Lilienfeld,et al.  Science and pseudoscience in clinical psychology: Initial thoughts, reflections, and considerations. , 2003 .