Advancing methods for reliably assessing motivational interviewing fidelity using the motivational interviewing skills code.

The current paper presents novel methods for collecting MISC data and accurately assessing reliability of behavior codes at the level of the utterance. The MISC 2.1 was used to rate MI interviews from five randomized trials targeting alcohol and drug use. Sessions were coded at the utterance-level. Utterance-based coding reliability was estimated using three methods and compared to traditional reliability estimates of session tallies. Session-level reliability was generally higher compared to reliability using utterance-based codes, suggesting that typical methods for MISC reliability may be biased. These novel methods in MI fidelity data collection and reliability assessment provided rich data for therapist feedback and further analyses. Beyond implications for fidelity coding, utterance-level coding schemes may elucidate important elements in the counselor-client interaction that could inform theories of change and the practice of MI.

[1]  R. Bakeman,et al.  Detecting Sequential Patterns and Determining Their Reliability With Fallible Observers , 2001 .

[2]  T. Moyers,et al.  Therapist influence on client language during motivational interviewing sessions. , 2006, Journal of substance abuse treatment.

[3]  Mark Liberman,et al.  Transcriber: Development and use of a tool for assisting speech corpora production , 2001, Speech Commun..

[4]  Panayiotis G. Georgiou,et al.  A Case Study: Detecting Counselor Reflections in Psychotherapy for Addictions using Linguistic Features , 2012, INTERSPEECH.

[5]  F. Rotgers.  Motivational Interviewing: Preparing People to Change Addictive Behavior , 1993 .

[6]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[7]  Sean J. Tollison,et al.  Questions and reflections: the use of motivational interviewing microskills in a peer-led brief alcohol intervention for college students. , 2008, Behavior therapy.

[8]  F. Crawford,et al.  A pilot study to establish a randomized trial methodology to test the efficacy of a behavioural intervention. , 2000, Health education research.

[9]  David C. Atkins,et al.  Randomized controlled trial of a Spring Break intervention to reduce high-risk drinking. , 2014, Journal of consulting and clinical psychology.

[10]  The Motivational Interviewing Skill Code: Reliability and a Critical Appraisal , 2005, Behavioural and Cognitive Psychotherapy.

[11]  Mohamed Faouzi,et al.  Counsellor behaviours and patient language during brief motivational interventions: a sequential analysis of speech. , 2008, Addiction.

[12]  G. Gmel,et al.  Change talk sequence during brief motivational intervention, towards or away from drinking. , 2010, Addiction.

[13]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[14]  Jon M. Houck,et al.  CACTI: Free, Open-Source Software for the Sequential Coding of Behavioral Interactions , 2012, PloS one.

[15]  David C. Atkins,et al.  Indicated prevention for college student marijuana use: a randomized controlled trial. , 2013, Journal of consulting and clinical psychology.

[16]  S. Adamson,et al.  Client language during motivational enhancement therapy and alcohol use outcome. , 2010, Behavioural and cognitive psychotherapy.

[17]  G. Gmel,et al.  Does change talk during brief motivational interventions with young men predict change in alcohol use? , 2013, Journal of substance abuse treatment.

[18]  David C. Atkins,et al.  Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification , 2014, Implementation Science.

[19]  David C. Atkins,et al.  A randomized controlled trial of event-specific prevention strategies for reducing problematic drinking associated with 21st birthday celebrations. , 2012, Journal of consulting and clinical psychology.

[20]  D. Spruijt-Metz,et al.  Boosting a Teen Substance Use Prevention Program with Motivational Interviewing , 2012, Substance use & misuse.

[21]  R. Ying.  Motivational interviewing: helping people change , 2013 .

[22]  David C. Atkins,et al.  Topic models: a novel method for modeling couple and family text data. , 2012, Journal of family psychology : JFP : journal of the Division of Family Psychology of the American Psychological Association.

[23]  P. Christopher,et al.  From in-session behaviors to drinking outcomes: a causal chain for motivational interviewing. , 2009, Journal of consulting and clinical psychology.

[24]  V. Rich.  Personal communication , 1989, Nature.

[25]  G. Gmel,et al.  Brief alcohol interventions: do counsellors' and patients' communication characteristics predict change? , 2007, Alcohol and alcoholism.

[26]  M. Mayo,et al.  Adherence to Principles of Motivational Interviewing and Client Within-Session Behavior , 2005, Behavioural and Cognitive Psychotherapy.

[27]  W. Miller,et al.  Motivational Interviewing: Preparing People to Change Addictive Behavior , 1991 .

[28]  Jon M Houck,et al.  The language of motivational interviewing and feedback: counselor language, client language, and client drinking outcomes. , 2010, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[29]  Jasjit S. Ahluwalia,et al.  Assessing the integrity of motivational interviewing interventions: Reliability of the motivational interviewing skills code , 2003 .

[30]  P. Christopher,et al.  Client language as a mediator of motivational interviewing efficacy: where is the evidence? , 2007, Alcoholism, clinical and experimental research.

[31]  Stephen Rollnick,et al.  Motivational Interviewing: Preparing People for Change, 2nd Edition , 2002 .

[32]  Antoinette Krupski,et al.  Testing the effects of brief intervention in primary care for problem drug use in a randomized controlled trial: rationale, design, and methods , 2012, Addiction Science & Clinical Practice.

[33]  Brian Borsari,et al.  The technical hypothesis of motivational interviewing: a meta-analysis of MI's key causal model. , 2014, Journal of consulting and clinical psychology.

[34]  T. Little,et al.  Using motivational interviewing with smokers: do therapist behaviors relate to engagement and therapeutic alliance? , 2006, Journal of substance abuse treatment.

[35]  W. Miller,et al.  Motivational interviewing: preparing people for change. , 2002 .

[36]  Stacey M. L. Hendrickson,et al.  How does motivational interviewing work? Therapist interpersonal skill predicts client involvement within motivational interviewing sessions. , 2005, Journal of consulting and clinical psychology.

[37]  Internet-based personalized feedback to reduce 21st-birthday drinking: a randomized controlled trial of an event-specific prevention intervention. , 2009, Journal of consulting and clinical psychology.

[38]  David C. Atkins,et al.  The association of therapist empathy and synchrony in vocally encoded arousal. , 2014, Journal of counseling psychology.

[39]  S. Galvani.  Motivational Interviewing: Helping People Change (3rd edition) , 2014 .

[40]  Jon M Houck,et al.  The structure of client language and drinking outcomes in project match. , 2011, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[41]  W. Miller,et al.  Client commitment language during motivational interviewing predicts drug use outcomes. , 2003, Journal of consulting and clinical psychology.

[42]  P. L. Peterson,et al.  Adolescent change language within a brief motivational intervention and substance use outcomes. , 2008, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[43]  Derrik R. Tollefson,et al.  A Meta-Analysis of Motivational Interviewing: Twenty-Five Years of Empirical Studies , 2010 .

[44]  D. Cicchetti.  Guidelines, Criteria, and Rules of Thumb for Evaluating Normed and Standardized Assessment Instruments in Psychology. , 1994 .