Practice-Based Evidence for Children and Adolescents: Advancing the Research Agenda in Schools

Abstract. The American Psychological Association Task Force on Evidence-Based Practice for Children and Adolescents (2008) recommended a systems approach to enhancing care in order to improve outcomes for children and adolescents with mental health needs and redress persistent systemic problems with the structure of services. Recommendations for enhancing an ecological approach to the adoption and implementation of evidence-based practices are offered through increased attention to practice-based research frameworks for adoption and dissemination. Five criteria are discussed for providing acceptable evidence, including (a) systematic evidence searching and adoption of evidence-based prevention and intervention practices, (b) implementation and adherence to intervention integrity, (c) invoking standards for drawing inferences from interventions, (d) using quality assessments to measure outcomes, and (e) adopting formal data analysis procedures to assess intervention outcomes. Each criterion is illustrated with an example. Future research and policy agendas are outlined.

[1]  Timothy J. Lewis,et al.  Schoolwide Positive Behavior Support: Building Systems to Develop and Maintain Appropriate Social Behavior , 2013 .

[2]  N. Humphrey,et al.  Modeling the Factors Associated With Children's Mental Health Difficulties in Primary School: A Multilevel Study , 2012 .

[3]  Stacy-Ann A. January,et al.  The Impact of Context and Word Type on Students' Maze Task Accuracy , 2012 .

[4]  Edward S. Shapiro,et al.  Comparing Computer-Adaptive and Curriculum-Based Measurement Methods of Assessment , 2012 .

[5]  S. Lilienfeld,et al.  Distinguishing science from pseudoscience in school psychology: science and scientific thinking as safeguards against human error. , 2012, Journal of school psychology.

[6]  Carolyn M. Evertson,et al.  Handbook of Classroom Management: Research, Practice, and Contemporary Issues , 2012 .

[7]  Joshua M. Langberg,et al.  Evaluation of the Homework, Organization, and Planning Skills (HOPS) Intervention for Middle School Students with ADHD as Implemented by School Mental Health Providers. , 2012, School psychology review.

[8]  J. Weisz,et al.  Youth Top Problems: using idiographic, consumer-guided assessment to identify treatment needs and to track change during psychotherapy. , 2011, Journal of consulting and clinical psychology.

[9]  M. Burns.  School Psychology Research: Combining Ecological Theory and Prevention Science , 2011 .

[10]  J. Matson,et al.  Treating Selective Mutism Using Modular CBT for Child Anxiety: A Case Study , 2011, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[11]  K. Davidson,et al.  Evidence Searching for Evidence-based Psychology Practice. , 2010, Professional psychology, research and practice.

[12]  K. Hawley,et al.  Understanding Barriers to Evidence-Based Assessment: Clinician Attitudes Toward Standardized Assessment Tools , 2010, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[13]  S. Reise,et al.  Evaluation of the Brief Problem Checklist: child and caregiver interviews to measure clinical progress. , 2010, Journal of consulting and clinical psychology.

[14]  J. Levin,et al.  Enhancing the scientific credibility of single-case intervention research: randomization to the rescue. , 2010, Psychological methods.

[15]  Robert H. Horner,et al.  Single-Case Designs Technical Documentation. , 2010 .

[16]  L. Fuchs,et al.  The “Blurring” of Special Education in a New Continuum of General Education Placements and Services , 2010 .

[17]  L. Bickman,et al.  Exploring the Black Box: Measuring Youth Treatment Process and Progress in Usual Care , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[18]  M. Cavaleri,et al.  Family Support in Children’s Mental Health: A Review and Synthesis , 2010, Clinical child and family psychology review.

[19]  Leonard Bickman,et al.  Change What? Identifying Quality Improvement Targets by Investigating Usual Mental Health Care , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[20]  Alan E. Kazdin,et al.  Single-Case Research Designs: Methods for Clinical and Applied Settings , 2010 .

[21]  J. Weisz,et al.  A meta-systems approach to evidence-based practice for children and adolescents. , 2010, The American psychologist.

[22]  D. Ellis,et al.  Treating Pediatric Obesity Using an Empirically Supported Treatment: A Case Report , 2009, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[23]  Kristen L. McMaster,et al.  The Prevention Science of Reading Research within a Response-to-Intervention Model. , 2010 .

[24]  David H. Barlow,et al.  Negative effects from psychological treatments: a perspective. , 2010, The American psychologist.

[25]  O. Walusinski.  Historical perspectives. , 2010, Frontiers of neurology and neuroscience.

[26]  Bryce D. McLeod,et al.  Conceptual and Methodological Issues in Treatment Integrity Measurement. , 2009 .

[27]  Jeffrey D Long,et al.  Curriculum-based measurement oral reading as an indicator of reading achievement: a meta-analysis of the correlational evidence. , 2009, Journal of school psychology.

[28]  J. Lochman,et al.  Implementation of a school-based prevention program: Effects of counselor and school characteristics. , 2009 .

[29]  Jason L. Horowitz,et al.  Practitioner and Site Characteristics That Relate to Fidelity of Implementation: The Early Risers Prevention Program in a Going-to-Scale Intervention Trial , 2009 .

[30]  S. Shaywitz,et al.  Response to Intervention: Ready or Not? Or, From Wait-to-Fail to Watch-Them-Fail. , 2009, School psychology quarterly : the official journal of the Division of School Psychology, American Psychological Association.

[31]  Susan H. Landry,et al.  Effectiveness of Comprehensive Professional Development for Teachers of At-Risk Preschoolers , 2009 .

[32]  C. Raver,et al.  Targeting children's behavior problems in preschool classrooms: a cluster-randomized controlled trial. , 2009, Journal of consulting and clinical psychology.

[33]  T. Kratochwill,et al.  Treatment integrity assessment in the schools: An evaluation of the Treatment Integrity Planning Protocol. , 2009 .

[34]  Matthew K. Burns,et al.  Evaluating Educational Interventions: Single-Case Design for Measuring Response to Intervention , 2009 .

[35]  J. Weisz,et al.  Modular Approach to Therapy for Children with Anxiety, Depression, Trauma, or Conduct Problems (MATCH-ADTC) , 2009 .

[36]  Sandra E. Larios,et al.  What Is Evidence-Based Treatment? , 2009 .

[37]  L. Bickman.  A measurement feedback system (MFS) is necessary to improve mental health outcomes. , 2008, Journal of the American Academy of Child and Adolescent Psychiatry.

[38]  W. Shadish,et al.  The state of the science in the meta-analysis of single-case experimental designs , 2008 .

[39]  K. Kutash,et al.  Reducing Behavior Problems in the Elementary School Classroom. IES Practice Guide. NCEE 2008-012. , 2008 .

[40]  S. Frazier,et al.  Closing the research to practice gap: Redefining feasibility , 2008 .

[41]  Russell E Glasgow,et al.  A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. , 2008, Joint Commission journal on quality and patient safety.

[42]  Alan E Kazdin,et al.  Evidence-based treatment and practice: new opportunities to bridge clinical research and practice, enhance the knowledge base, and improve patient care. , 2008, The American psychologist.

[43]  M. D. Murphy,et al.  Clinical practice as natural laboratory for psychotherapy research: a guide to case-based time-series analysis. , 2008, The American psychologist.

[44]  L. Vitulano,et al.  Modular Cognitive-Behavioral Therapy for Childhood Anxiety Disorders , 2008 .

[45]  Eric L. Daleiden,et al.  Driving with Roadmaps and Dashboards: Using Information Resources to Structure the Decision Models in Service Organizations , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[46]  K. Kelleher,et al.  Assessing the Organizational Social Context (OSC) of Mental Health Services: Implications for Research and Practice , 2008, Administration and Policy in Mental Health and Mental Health Services Research.

[47]  Richard I. Parker,et al.  Single case research results as clinical outcomes , 2007 .

[48]  S. Sheridan,et al.  Conjoint behavioral consultation : promoting family-school connections and interventions , 2007 .

[49]  S. Vaughn,et al.  Introduction to the Special Series on Service Delivery Systems for Response to Intervention: Considerations for Research and Practice , 2007 .

[50]  J. DiPerna,et al.  Service Delivery for Response to Intervention: Core Components and Directions for Future Research , 2007 .

[51]  Thomas R Kratochwill,et al.  Preparing psychologists for evidence-based school practice: lessons learned and challenges ahead. , 2007, The American psychologist.

[52]  B. Thorn,et al.  Evidence-based practice in psychology. , 2006, The American psychologist.

[53]  S. Frazier,et al.  Can't Have One without the Other: Mental Health Providers and Community Parents Reducing Barriers to Services for Families in Urban Poverty. , 2007 .

[54]  Andrew T. Roach,et al.  Universal and Early Screening for Educational Difficulties: Current and Future Approaches. , 2007 .

[55]  K. Hoagwood,et al.  Early identification of mental health problems in schools: The status of instrumentation. , 2007 .

[56]  E. Cappella,et al.  Linking Mental Health and After School Systems for Children in Urban Poverty: Preventing Problems, Promoting Possibilities , 2007, Administration and Policy in Mental Health and Mental Health Services Research.

[57]  David Rindskopf,et al.  Methods for evidence‐based practice: Quantitative synthesis of single‐subject designs , 2007 .

[58]  T. Kratochwill,et al.  Response to Intervention: Conceptual and Methodological Issues in Implementation , 2007 .

[59]  T. Kratochwill,et al.  Treatment Integrity in Behavioral Consultation: Measurement, Promotion, and Outcomes , 2007 .

[60]  E. Cappella,et al.  Linking Mental Health and After School Systems for Children in Urban Poverty: Preventing Problems, Promoting Possibilities , 2007, Administration and Policy in Mental Health and Mental Health Services Research.

[61]  A. Vanderheyden,et al.  Handbook of response to intervention : the science and practice of assessment and intervention , 2007 .

[62]  C. Shieh.  Practice‐Based Evidence , 2006 .

[63]  J. Weisz,et al.  Evidence-based youth psychotherapies versus usual clinical care: a meta-analysis of direct comparisons. , 2006, The American psychologist.

[64]  Michael J. Lambert,et al.  Is It Time for Clinicians to Routinely Track Patient Outcome? A Meta‐Analysis , 2006 .

[65]  John R. Weisz,et al.  Treatment dissemination and evidence-based practice: Strengthening intervention through clinician-researcher collaboration , 2006 .

[66]  Theodore J. Christ.  Short-Term Estimates of Growth Using Curriculum-Based Measurement of Oral Reading Fluency: Estimating Standard Error of the Slope to Construct Confidence Intervals , 2006 .

[67]  Lawrence W Green,et al.  Public health asks of systems science: to advance our evidence-based practice, can you help us get more practice-based evidence? , 2006, American journal of public health.

[68]  Judith M. Lapointe,et al.  Research-Based Programs for Preventing and Solving Discipline Problems , 2006 .

[69]  Sheri L. Robinson,et al.  Helping Individual Students with Problem Behavior , 2006 .

[70]  Herbert J. Walberg,et al.  The scientific basis of educational productivity , 2006 .

[71]  C. Shieh.  Practice-based evidence. How one nurse turned her day-to-day experiences into research. , 2006, AWHONN lifelines.

[72]  S. Monga.  Psychotherapy for Children and Adolescents: Evidence-Based Treatments and Case Examples , 2005 .

[73]  P. Mrazek,et al.  Transforming mental health care for children and their families. , 2005, The American psychologist.

[74]  J. Durlak,et al.  Promoting and protecting youth mental health through evidence-based prevention and treatment. , 2005, The American psychologist.

[75]  Robert F. Boruch,et al.  Standards of Evidence: Criteria for Efficacy, Effectiveness and Dissemination , 2005, Prevention Science.

[76]  T. Power,et al.  Reconceptualizing intervention integrity: A partnership‐based framework for linking research with practice , 2005 .

[77]  A. Gaw,et al.  School-Based Mental Health Services: Creating Comprehensive and Culturally Specific Programs , 2005 .

[78]  M. Wolery,et al.  The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education , 2005 .

[79]  Karen A. Blase,et al.  Implementation Research: A Synthesis of the , 2005 .

[80]  Angela M. O'Donnell,et al.  Educational/Psychological Intervention Research , 2003 .

[81]  J. Fantuzzo,et al.  Forging Strategic Partnerships to Advance Mental Health Science and Practice for Vulnerable Children , 2003 .

[82]  S. Kellett,et al.  From research and development to practice-based evidence: clinical governance initiatives in a service for adults with mild intellectual disability and mental health needs. , 2003, Journal of intellectual disability research : JIDR.

[83]  Lawrence R. James,et al.  The cross‐level effects of culture and climate in human service teams , 2002 .

[84]  Christopher R. Thomas,et al.  Child and Adolescent Therapy: Cognitive-Behavioral Procedures , 2001 .

[85]  Robin K. Morgan,et al.  Single-participant research design. Bringing science to managed care. , 2001, The American psychologist.

[86]  T. Kratochwill,et al.  Empirically supported interventions in school psychology: The role of negative results in outcome research , 2000 .

[87]  R. Hawkins,et al.  Frequent monitoring of clinical outcomes: Research and accountability for clinical practice. , 1999 .

[88]  S. Hayes,et al.  The Scientist Practitioner: Research and Accountability in the Age of Managed Care , 1999 .

[89]  J. Weisz,et al.  Finding, evaluating, refining, and applying empirically supported treatments for children and adolescents. , 1998, Journal of clinical child psychology.

[90]  G W Rebok,et al.  The course and malleability of aggressive behavior from early first grade into middle school: results of a developmental epidemiologically-based preventive trial. , 1994, Journal of child psychology and psychiatry, and allied disciplines.

[91]  Frank M. Gresham,et al.  Assessment of Treatment Integrity in School Consultation and Prereferral Intervention. , 1989 .

[92]  A. Kazdin,et al.  Beyond clinical trials: generalizing from research to practice , 1986 .

[93]  T. Kratochwill.  Case study research in school psychology. , 1985 .

[94]  M. E. Boyle.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1983 .

[95]  C. Reynolds,et al.  The Handbook of School Psychology , 1982 .

[96]  D. Barlow,et al.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1976 .

[97]  Albert,et al.  THE CHILDREN'S HOSPITAL OF PHILADELPHIA , 1955 .