Achieving successful evidence-based practice implementation in juvenile justice: The importance of diagnostic and evaluative capacity.

Evidence-based programs (EBPs) are an increasingly visible aspect of the treatment landscape in juvenile justice. Research demonstrates that such programs yield positive returns on investment and are replacing more expensive, less effective options. However, programs are unlikely to produce expected benefits when they are not well-matched to community needs, not sustained and do not reach sufficient reach and scale. We argue that achieving these benchmarks for successful implementation will require states and county governments to invest in data-driven decision infrastructure in order to respond in a rigorous and flexible way to shifting political and funding climates. We conceptualize this infrastructure as diagnostic capacity and evaluative capacity: Diagnostic capacity is defined as the process of selecting appropriate programing and evaluative capacity is defined as the ability to monitor and evaluate progress. Policy analyses of Washington State, Pennsylvania and Louisiana's program implementation successes are used to illustrate the benefits of diagnostic and evaluate capacity as a critical element of EBP implementation.

[1]  R. Winkens,et al.  A cluster randomized controlled trial aimed at implementation of local quality improvement collaboratives to improve prescribing and test ordering performance of general practitioners: Study Protocol , 2009, Implementation science : IS.

[2]  T E Backer,et al.  Dissemination and adoption of innovative psychosocial interventions. , 1986, Journal of consulting and clinical psychology.

[3]  C. Jordens,et al.  Multiplying health gains: the critical role of capacity-building within health promotion programs. , 1997, Health policy.

[4]  Kehu Yang,et al.  Editorial: can China master the guideline challenge? , 2013, Health Research Policy and Systems.

[5]  J. Lowery,et al.  Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science , 2009, Implementation science : IS.

[6]  T. Grisso Progress and perils in the juvenile justice and mental health movement. , 2007, The journal of the American Academy of Psychiatry and the Law.

[7]  Anthony L. Hemmelgarn,et al.  Randomized trial of MST and ARC in a two-level evidence-based treatment implementation strategy. , 2010, Journal of consulting and clinical psychology.

[8]  James G. Emshoff,et al.  Researchers, Practitioners, and Funders: Using the Framework to Get Us on the Same Page , 2008, American journal of community psychology.

[9]  A. Boyd,et al.  Frameworks for evaluating health research capacity strengthening: a qualitative study , 2013, Health Research Policy and Systems.

[10]  Mark W. Lipsey,et al.  Improving the Effectiveness of Juvenile Justice Programs: A New Perspective on Evidence-Based Practice , 2010 .

[11]  Julia E. Moore,et al.  Sustaining Evidence-Based Prevention Programs: Correlates in a Large-Scale Dissemination Initiative , 2013, Prevention Science.

[12]  Patricia Chamberlain,et al.  Three Collaborative Models for Scaling Up Evidence-Based Practices , 2012, Administration and Policy in Mental Health and Mental Health Services Research.

[13]  L. Palinkas,et al.  Dynamic adaptation process to implement an evidence-based child maltreatment intervention , 2012, Implementation Science.

[14]  S. Schoenwald,et al.  Effectiveness, transportability, and dissemination of interventions: what matters when? , 2001, Psychiatric services.

[15]  C. Turner,et al.  The effectiveness of functional family therapy for youth with behavioral problems in a community practice setting. , 2010, Journal of family psychology : JFP : journal of the Division of Family Psychology of the American Psychological Association.

[16]  Jennifer Duffy,et al.  Unpacking Prevention Capacity: An Intersection of Research-to-practice Models and Community-centered Models , 2008, American journal of community psychology.

[17]  Abraham Wandersman,et al.  A Research Synthesis of the Evaluation Capacity Building Literature , 2012 .

[18]  Michael W. Arthur,et al.  Promoting science-based prevention in communities. , 2002, Addictive behaviors.

[19]  Kimberly Eaton Hoagwood,et al.  Understanding the components of quality improvement collaboratives: a systematic literature review. , 2013, The Milbank quarterly.

[20]  Daniel E. Bontempo,et al.  Predictors and level of sustainability of community prevention coalitions. , 2008, American Journal of Preventive Medicine.

[21]  L. Damschroder,et al.  A guiding framework and approach for implementation research in substance use disorders treatment. , 2011, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[22]  A. Mack Testing Standard and Modular Designs for Psychotherapy Treating Depression, Anxiety, and Conduct Problems in Youth: A Randomized Effectiveness Trial , 2013 .

[23]  David A. Chambers,et al.  Federal, state, and foundation initiatives around evidence-based practices for child and adolescent mental health. , 2005, Child and adolescent psychiatric clinics of North America.

[24]  M. Sanders,et al.  Surviving or Thriving: Quality Assurance Mechanisms to Promote Innovation in the Development of Evidence-Based Parenting Interventions , 2014, Prevention Science.

[25]  R. Abbott,et al.  Variation in the Sustained Effects of the Communities That Care Prevention System on Adolescent Smoking, Delinquency, and Violence , 2014, Prevention Science.

[26]  J. Hawkins,et al.  Sustained effects of the Communities That Care system on prevention service system transformation. , 2013, American journal of public health.

[27]  Julia E. Moore,et al.  Examining Adaptations of Evidence-Based Programs in Natural Contexts , 2013, The Journal of Primary Prevention.

[28]  Janet Clinton The True Impact of Evaluation , 2011 .

[29]  G. Aarons,et al.  Advancing a Conceptual Model of Evidence-Based Practice Implementation in Public Service Sectors , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[30]  J. Cocozza,et al.  Advancing Evidence-Based Practices for Juvenile Justice Reform Through Community Development , 2013 .

[31]  Youth Outcomes Study , 2011 .

[32]  David A Chambers,et al.  Bridging research and practice: models for dissemination and implementation research. , 2012, American journal of preventive medicine.

[33]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[34]  Mark W. Lipsey,et al.  A broader view of evidence-based programs reveals more options for state juvenile justice systems , 2012 .

[35]  Michelle E. Jordan,et al.  The role of conversation in health care interventions: enabling sensemaking and learning , 2009, Implementation science : IS.

[36]  P. Greenwood Prevention and Intervention Programs for Juvenile Offenders , 2008, The Future of children.

[37]  Mark W. Lipsey,et al.  Effective Intervention for Serious Juvenile Offenders , 2000 .

[38]  A. Wandersman,et al.  The Getting To Outcomes Demonstration and Evaluation: An Illustration of the Prevention Support System , 2008, American journal of community psychology.

[39]  Brittany L. Rhoades,et al.  The Role of a State-Level Prevention Support System in Promoting High-Quality Implementation and Sustainability of Evidence-Based Programs , 2012, American journal of community psychology.

[40]  Inger P. Davis,et al.  Bridging science and practice in child welfare and children’s mental health service systems through a two-decade research center trajectory , 2011 .

[41]  G. Robert,et al.  Diffusion of innovations in service organizations: systematic review and recommendations. , 2004, The Milbank quarterly.

[42]  N. Ialongo,et al.  Unpacking the Black Box of Implementation: The Next Generation for Policy, Research and Practice , 2013, Administration and Policy in Mental Health and Mental Health Services Research.

[43]  Barry Glick,et al.  Aggression replacement training , 1987 .

[44]  Peter W. Greenwood,et al.  Overview of: “Promoting Evidence‐Based Practice in Delinquency Prevention at the State Level: Principles, Progress, and Policy Directions” , 2012 .

[45]  J. Durlak,et al.  Implementation Matters: A Review of Research on the Influence of Implementation on Program Outcomes and the Factors Affecting Implementation , 2008, American journal of community psychology.

[46]  Susan Michie,et al.  Specifying and reporting complex behaviour change interventions: the need for a scientific method , 2009, Implementation science : IS.

[47]  Brandon C. Welsh,et al.  Promoting Evidence‐Based Practice in Delinquency Prevention at the State Level , 2012 .

[48]  S. Henggeler,et al.  Multisystemic therapy: monitoring treatment fidelity. , 2000, Family process.

[49]  Daniel E. Bontempo,et al.  Effects of the Communities That Care Model in Pennsylvania on Change in Adolescent Risk and Problem Behaviors , 2010, Prevention Science.

[50]  Sonja K Schoenwald,et al.  The ARC Organizational and Community Intervention Strategy for Implementing Evidence-Based Children's Mental Health Treatments , 2005, Mental health services research.

[51]  Jennifer Duffy,et al.  Bridging the Gap Between Prevention Research and Practice: The Interactive Systems Framework for Dissemination and Implementation , 2008, American journal of community psychology.

[53]  D. Julian A Community Practice Model for Community Psychologists and Some Examples of the Application of Community Practice Skills from the Partnerships for Success Initiative in Ohio , 2006, American journal of community psychology.

[54]  Delbert S. Elliott,et al.  Issues in Disseminating and Replicating Effective Prevention Programs , 2004, Prevention Science.

[55]  Jeffery Adams,et al.  Evaluation Training to Build Capability in the Community and Public Health Workforce , 2010 .

[56]  D. Wayne Osgood,et al.  Readiness, Functioning, and Perceived Effectiveness in Community Prevention Coalitions: A Study of Communities That Care , 2004, American journal of community psychology.

[57]  Enola K Proctor,et al.  A Systematic Review of Strategies for Implementing Empirically Supported Mental Health Interventions , 2014, Research on social work practice.

[58]  Abigail A. Fagan,et al.  Strategies for enhancing the adoption of school‐based prevention programs: Lessons learned from the Blueprints for Violence Prevention replications of the Life Skills Training program , 2003 .