Therapist Report of Adaptations to Delivery of Evidence-Based Practices Within a System-Driven Reform of Publicly Funded Children’s Mental Health Services

Objective: This study examined clinical adaptations reported by community therapists to multiple evidence-based practices (EBPs) currently implemented in children’s mental health services. Based on an item set informed by Stirman and colleagues’ model (2015), 2 factors emerged describing Augmenting adaptations and Reducing/Reordering adaptations. We used multilevel modeling to examine therapist- and practice-level predictors of therapist reports of each type of adaptation. Method: Data were drawn from an online survey, including a novel therapist report measure of EBP adaptations, completed by 572 therapists (89.2% female, Mage = 37.08 years, 33.4% non-Hispanic White) delivering EBPs in the context of a system-driven, fiscally mandated implementation effort. Results: Analyses revealed that the 2 types of therapist adaptations (Augmenting and Reducing/Reordering) could be readily discriminated, with therapists reporting significantly more Augmenting than Reducing/Reordering adaptations. Therapists of Hispanic/Latino ethnicity and with fewer years of experience reported more extensive Augmenting adaptations, but no therapist background characteristics were associated with Reducing/Reordering adaptations. Therapists’ general attitudes that EBPs diverged from their personal approach to therapy were associated with reporting more Augmenting and Reducing/Reordering adaptations. In contrast, negative perceptions toward the specific EBP predicted Reducing/Reordering adaptations, but not Augmenting adaptations. Conclusions: Community therapist reports suggest that most adaptations undertaken involve engaging with the practice to augment the fit of the EBPs for local contexts; however, when practices were perceived negatively, therapists were more likely to make adaptations reducing or rearranging components.

[1]  A. Lau,et al.  How Intervention and Implementation Characteristics Relate to Community Therapists’ Attitudes Toward Evidence-Based Practices: A Mixed Methods Study , 2017, Administration and Policy in Mental Health and Mental Health Services Research.

[2]  Shannon Wiltsey Stirman,et al.  Development of a framework and coding system for modifications and adaptations of evidence-based interventions , 2013, Implementation Science.

[3]  B. Chorpita,et al.  MAPping Los Angeles County: Taking an Evidence-Informed Model of Mental Health Care to Scale , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[4]  B. Bloom.  Crossing the Quality Chasm: A New Health System for the 21st Century , 2002 .

[5]  Kristopher J Preacher,et al.  Reliability estimation in a multilevel confirmatory factor analysis framework. , 2014, Psychological methods.

[6]  L. Palinkas,et al.  Dynamic adaptation process to implement an evidence-based child maltreatment intervention , 2012, Implementation Science.

[7]  Catherine M. Lee,et al.  Service Providers’ Adherence to an Evidence-Based Parenting Program: What are They Missing and Why? , 2015 .

[8]  A. Lau,et al.  The 4KEEPS study: identifying predictors of sustainment of multiple practices fiscally mandated in children’s mental health services , 2015, Implementation Science.

[9]  Andrew F. Hayes,et al.  A Primer on Multilevel Modeling , 2006 .

[10]  Joyce P Chu,et al.  Advancement in the Maturing Science of Cultural Adaptations of Evidence-Based Interventions , 2017, Journal of consulting and clinical psychology.

[11]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[12]  J. Weisz,et al.  Integrity of Evidence-Based Practice: Are Providers Modifying Practice Content or Practice Sequencing? , 2015, Administration and Policy in Mental Health and Mental Health Services Research.

[13]  L. Brookman-Frazee,et al.  Training Community Mental Health Therapists to Deliver a Package of Evidence-Based Practice Strategies for School-Age Children with Autism Spectrum Disorders: A Pilot Study , 2011, Journal of Autism and Developmental Disorders.

[14]  G. Aarons.  Mental Health Provider Attitudes Toward Adoption of Evidence-Based Practice: The Evidence-Based Practice Attitude Scale (EBPAS) , 2004, Mental health services research.

[15]  E. Rogers,et al.  Diffusion of innovations , 1964, Encyclopedia of Sport Management.

[16]  Brad J. Nakamura,et al.  Long-term outcomes for the Child STEPs randomized effectiveness trial: a comparison of modular and standard treatment designs with usual care. , 2013, Journal of consulting and clinical psychology.

[17]  P. Bentler,et al.  Cutoff criteria for fit indexes in covariance structure analysis : Conventional criteria versus new alternatives , 1999 .

[18]  A. Lau.  Making the Case for Selective and Directed Cultural Adaptations of Evidence-Based Treatments: Examples From Parent Training , 2006 .

[19]  G. Bernal,et al.  Are empirically supported treatments valid for ethnic minorities? Toward an alternative approach for treatment research. , 2001, Cultural diversity & ethnic minority psychology.

[20]  D. Gibbs,et al.  Implementer-initiated adaptation of evidence-based interventions: kids remember the blue wig. , 2016, Health education research.

[21]  A. Baumann,et al.  Cultural Adaptation of an Evidence Based Intervention: From Theory to Practice in a Latino/a Community Context , 2011, American journal of community psychology.

[22]  M. Southam-Gerow,et al.  Integrating Interventions and Services Research: Progress and Prospects , 2006 .

[23]  J. Weisz,et al.  Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? , 2009, Psychiatric services.

[24]  Seth J. Gillihan,et al.  Challenges and Successes in Dissemination of Evidence-Based Treatments for Posttraumatic Stress , 2013, Psychological science in the public interest : a journal of the American Psychological Society.

[25]  Catherine M. Lee,et al.  So now we've picked an evidence-based program, what's next? Perspectives of service providers and administrators. , 2011 .

[26]  M. Cashel.  Child and Adolescent Psychological Assessment: Current Clinical Practices and the Impact of Managed Care , 2002 .

[27]  J. Sigmund.  Seeking Safety: A Treatment Manual for PTSD and Substance Abuse , 2002 .

[28]  J. R. Cook,et al.  Do Noncontingent Incentives Increase Survey Response Rates among Mental Health Providers? A Randomized Trial Comparison , 2009, Administration and Policy in Mental Health and Mental Health Services Research.

[29]  B. Chorpita,et al.  Providers’ Attitudes Toward Evidence-Based Practices: Is it Just About Providers, or Do Practices Matter, Too? , 2014, Administration and Policy in Mental Health and Mental Health Services Research.

[30]  Mario Hernandez,et al.  Evidence-based Treatments in the Field: A Brief Report on Provider Knowledge, Implementation, and Practice , 2006, The Journal of Behavioral Health Services & Research.

[31]  R. Alaggia,et al.  Implementing an Evidence-Based Parenting Program With Adherence in the Real World of Community Practice , 2008 .

[32]  C. Piotrowski,et al.  Psychological testing in outpatient mental health facilities: a national study , 1989 .

[33]  P. Schnurr,et al.  Perceived Characteristics of Intervention Scale , 2015, Assessment.

[34]  S. Morgan.  Community Mental Health , 1993, Therapy in Practice Series.

[35]  S. Beck,et al.  Preferred Assessment Methods and Treatment Modalities for Hyperactive Children Among Clinical Child and School Psychologists , 1986 .

[36]  Eugene Aisenberg.  Evidence-based practice in mental health care to ethnic minority communities: has its practice fallen short of its evidence? , 2008, Social work.

[37]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[38]  B. Cooper,et al.  Adaptations in a Community-Based Family Intervention: Replication of Two Coding Schemes , 2016, The Journal of Primary Prevention.

[39]  Christopher J. Miller,et al.  Community mental health provider modifications to cognitive therapy: implications for sustainability. , 2013, Psychiatric services.

[40]  I. Miller,et al.  Let your intuition be your guide? Individual differences in the evidence-based practice attitudes of psychotherapists. , 2011, Journal of evaluation in clinical practice.

[41]  David A Chambers,et al.  The Adaptome: Advancing the Science of Intervention Adaptation. , 2016, American journal of preventive medicine.

[42]  D. Racine.  Reliable Effectiveness: A Theory on Sustaining and Replicating Worthwhile Innovations , 2006, Administration and Policy in Mental Health and Mental Health Services Research.

[43]  J. Crosby,et al.  Treatment Beliefs and Techniques of Clinicians Serving Child Maltreatment Survivors , 2014, Child maltreatment.

[44]  B. Thorn,et al.  Evidence-based practice in psychology. , 2006, The American psychologist.

[45]  A. Evans,et al.  Relationships between clinician-level attributes and fidelity-consistent and fidelity-inconsistent modifications to an evidence-based psychotherapy , 2015, Implementation Science.

[46]  M. Sanders,et al.  Practitioner perceptions of the use of the Triple P - Positive Parenting Program with families from culturally diverse backgrounds. , 2012, Australian journal of primary health.

[47]  T. Baranowski,et al.  Cultural sensitivity in public health: defined and demystified. , 1999, Ethnicity & disease.

[48]  A. Lieberman,et al.  Psychotherapy with Infants and Young Children: Repairing the Effects of Stress and Trauma on Early Attachment , 2008 .

[49]  M. Sanders,et al.  Facilitating Practitioner Flexibility Within an Empirically Supported Intervention: Lessons From a System of Parenting Support , 2010 .

[50]  K. Kelleher,et al.  Psychometric properties and U.S. National norms of the Evidence-Based Practice Attitude Scale (EBPAS). , 2010, Psychological assessment.

[51]  C. Becker,et al.  A survey of psychologists' attitudes towards and utilization of exposure therapy for PTSD. , 2004, Behaviour research and therapy.

[52]  Robert A. Williams,et al.  Brief Strategic Family Therapy: Twenty-Five Years of Interplay Among Theory, Research and Practice in Adolescent Behavior Problems and Drug Abuse , 2000, Clinical child and family psychology review.

[53]  Aaron R. Lyon,et al.  A case for modular design: Implications for implementing evidence-based interventions with culturally-diverse youth. , 2014, Professional psychology, research and practice.

[54]  B. Chorpita,et al.  Mapping evidence-based treatments for children and adolescents: application of the distillation and matching model to 615 treatments from 322 randomized trials. , 2009, Journal of consulting and clinical psychology.

[55]  Steven M. Giles,et al.  Styles of Adaptation: The Impact of Frequency and Valence of Adaptation on Preventing Substance Use. , 2013, Health education.

[56]  Apa Presidential Task Force on Evidence-Based Practice.  Evidence-based practice in psychology. , 2006 .

[57]  M. Leavitt.  Medscape's response to the Institute of Medicine Report: Crossing the quality chasm: a new health system for the 21st century. , 2001, MedGenMed : Medscape general medicine.

[58]  Leopoldo J. Cabassa,et al.  A two-way street: bridging implementation science and cultural adaptations of mental health treatments , 2013, Implementation Science.

[59]  D. Bigfoot,et al.  Honoring children, mending the circle: cultural adaptation of trauma-focused cognitive-behavioral therapy for American Indian and Alaska native children. , 2010, Journal of clinical psychology.

[60]  M. Southam-Gerow,et al.  Adapting Evidence-Based Mental Health Treatments in Community Settings , 2009, Behavior modification.

[61]  R. McMahon,et al.  Adherence and Flexibility: They Can (and Do) Coexist! , 2010 .