Determinants and Functions of Standardized Assessment Use Among School Mental Health Clinicians: A Mixed Methods Evaluation

The current study evaluated why and how school mental health clinicians use standardized assessment tools in their work with youth and families. Quantitative and qualitative (focus group) data were collected prior to and following a training and consultation sequence as part of a trial program to assess school clinician’s (n = 15) experiences administering standardized tools to youth on their caseloads (n = 191). Findings indicated that, although assessment use was initially somewhat low, clinicians used measures to conduct initial assessments with the bulk of their caseloads (average = 62.2 %) during the implementation period. Clinicians also reported on factors influencing their use of assessments at the client, provider, and system levels; perceived functions of assessment; student responses to assessment use; and use of additional sources of clinically-relevant information (primarily educational data) for the purposes of assessment and progress monitoring. Implications for the contextual appropriateness of standardized assessment and training in assessment tools are discussed.

[1]  J. Weisz,et al.  Provider attitudes toward evidence-based practices: are the concerns with the evidence or with the manuals? , 2009, Psychiatric services.

[2]  Hsiu-Fang Hsieh,et al.  Three Approaches to Qualitative Content Analysis , 2005, Qualitative health research.

[3]  F. Zitman,et al.  Routine outcome monitoring and feedback on physical or mental health status: evidence and theory. , 2012, Journal of evaluation in clinical practice.

[4]  Aaron R. Lyon,et al.  Client Progress Monitoring and Feedback in School-Based Mental Health , 2015 .

[5]  Janet Mancini Billson,et al.  Focus Groups: A Practical Guide for Applied Research , 1989 .

[6]  M. Laurant,et al.  Factors associated with the impact of quality improvement collaboratives in mental healthcare: An exploratory study , 2012, Implementation Science.

[7]  J. Parker,et al.  The Multidimensional Anxiety Scale for Children (MASC): factor structure, reliability, and validity. , 1997, Journal of the American Academy of Child and Adolescent Psychiatry.

[8]  T. Elkin,et al.  Handbook of evidence-based therapies for children and adolescents : bridging science and practice , 2008 .

[9]  Lawrence A. Palinkas,et al.  Mixed Method Designs in Implementation Research , 2010, Administration and Policy in Mental Health and Mental Health Services Research.

[10]  Lawrence A. Palinkas,et al.  Mixed-methods designs in mental health services research: a review. , 2011, Psychiatric services.

[11]  Gregory A. Aarons,et al.  Clinicians and outcome measurement: What's the use? , 2003, The Journal of Behavioral Health Services & Research.

[12]  Elizabeth H. Connors,et al.  Evidence-Based Assessment in School Mental Health , 2015 .

[13]  Aaron R. Lyon,et al.  “If It’s Worth My Time, I will Make the Time”: School-Based Providers’ Decision-Making About Participating in an Evidence-Based Psychotherapy Consultation Program , 2013, Administration and Policy in Mental Health and Mental Health Services Research.

[14]  A. Mack Testing Standard and Modular Designs for Psychotherapy Treating Depression, Anxiety, and Conduct Problems in Youth: A Randomized Effectiveness Trial , 2013 .

[15]  B. Chorpita,et al.  Evidence-Based Therapies: Translating Research into Practice , 2008 .

[16]  Manuel Riemer,et al.  Effects of routine feedback to clinicians on mental health outcomes of youths: results of a randomized trial. , 2011, Psychiatric services.

[17]  B. Chorpita,et al.  From data to wisdom: quality improvement strategies supporting large-scale implementation of evidence-based services. , 2005, Child and adolescent psychiatric clinics of North America.

[18]  Alan E. Kazdin,et al.  Treatment Outcomes, Common Factors, and Continued Neglect of Mechanisms of Change , 2006 .

[19]  John Hunsley,et al.  A Guide to Assessments That Work , 2008 .

[20]  K. Hawley,et al.  Understanding Clinicians’ Diagnostic Practices: Attitudes Toward the Utility of Diagnosis and Standardized Diagnostic Tools , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[21]  K. Hawley,et al.  Understanding Barriers to Evidence-Based Assessment: Clinician Attitudes Toward Standardized Assessment Tools , 2010, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[22]  Eric J. Bruns,et al.  Impact of School-Based Health Center use on academic outcomes. , 2010, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[23]  David A. Chambers,et al.  The dynamic sustainability framework: addressing the paradox of sustainment amid ongoing change , 2013, Implementation Science.

[24]  L. Palinkas,et al.  Dynamic adaptation process to implement an evidence-based child maltreatment intervention , 2012, Implementation Science.

[25]  B. Ogles,et al.  Why Some Clinicians Use Outcome Measures and Others Do Not , 2007, Administration and Policy in Mental Health and Mental Health Services Research.

[26]  Richard A. Krueger,et al.  Focus groups : a practical guide for applied research / by Richard A. Krueger , 1989 .

[27]  David H Barlow,et al.  The dissemination and implementation of evidence-based psychological treatments. A review of current efforts. , 2010, The American psychologist.

[28]  Aaron R. Lyon,et al.  Using Modular Psychotherapy in School Mental Health: Provider Perspectives on Intervention-Setting Fit , 2014, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[29]  Aaron R. Lyon,et al.  Modular Psychotherapy for Youth With Internalizing Problems: Implementation With Therapists in School-Based Health Centers , 2011 .

[30]  Bonnie Gance-Cleveland,et al.  Benefits of a School-Based Health Center in a Preschool , 2005, Clinical nursing research.

[31]  B. Ogles,et al.  The use of outcome measures by psychologists in clinical practice , 2004 .

[32]  A. Jensen-Doss Practical, Evidence-Based Clinical Decision Making: Introduction to the Special Series , 2015 .

[33]  Wayne Katon,et al.  Evaluation of the Patient Health Questionnaire-9 Item for Detecting Major Depression Among Adolescents , 2010, Pediatrics.

[34]  J. Hunsley,et al.  Evidence-Based Assessment of Child and Adolescent Disorders: Issues and Challenges , 2005, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[35]  Kelli Scott,et al.  Using Measurement-Based Care to Enhance Any Treatment. , 2015, Cognitive and behavioral practice.

[36]  D. Ugarriza,et al.  The Concept of Theme as Used in Qualitative Nursing Research , 2000, Western journal of nursing research.

[37]  M. Salzer,et al.  What information do clinicians value for monitoring adolescent client progress and outcomes , 2000 .

[38]  C. Hill,et al.  A Guide to Conducting Consensual Qualitative Research , 1997 .

[39]  Aaron R Lyon,et al.  From distal to proximal: routine educational data monitoring in school-based mental health , 2013, Advances in school mental health promotion.

[40]  G. Aarons,et al.  Evidence-based practice implementation: The impact of public versus private sector organization type on organizational support, provider attitudes, and adoption of evidence-based practice , 2009, Implementation science : IS.

[41]  Michael J. Lambert,et al.  Is It Time for Clinicians to Routinely Track Patient Outcome? A Meta‐Analysis , 2006 .

[42]  J. Parker,et al.  Test-retest reliability of the Multidimensional Anxiety Scale for Children. , 1999, Journal of anxiety disorders.

[43]  T. Trauer,et al.  Consumer attitudes towards the use of routine outcome measures in a public mental health service: a consumer-driven study. , 2008, International journal of mental health nursing.

[44]  Nicholas Ladany,et al.  Consensual Qualitative Research: An Update , 2005 .

[45]  Lucy Berliner,et al.  Clinician Use of Standardized Assessments Following a Common Elements Psychotherapy Training and Consultation Program , 2014, Administration and Policy in Mental Health and Mental Health Services Research.

[46]  Aaron R. Lyon,et al.  Developing the Mental Health Workforce: Review and Application of Training Approaches from Multiple Disciplines , 2011, Administration and Policy in Mental Health and Mental Health Services Research.

[47]  B. Chorpita,et al.  Implementation of Evidence-Based Services for Youth , 2009, Behavior modification.

[48]  R. Spitzer,et al.  Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. , 1999, JAMA.

[49]  L. Danielson,et al.  Responsiveness to Intervention: 1997 to 2007 , 2007 .