"It sounds like...": A natural language processing approach to detecting counselor reflections in motivational interviewing.

The dissemination and evaluation of evidence-based behavioral treatments for substance abuse problems rely on the evaluation of counselor interventions. In Motivational Interviewing (MI), a treatment that directs the therapist to utilize a particular linguistic style, proficiency is assessed via behavioral coding-a time consuming, nontechnological approach. Natural language processing techniques have the potential to scale up the evaluation of behavioral treatments such as MI. We present a novel computational approach to assessing components of MI, focusing on 1 specific counselor behavior-reflections, which are believed to be a critical MI ingredient. Using 57 sessions from 3 MI clinical trials, we automatically detected counselor reflections in a maximum entropy Markov modeling framework using the raw linguistic data derived from session transcripts. We achieved 93% recall, 90% specificity, and 73% precision. Results provide insight into the linguistic information used by coders to make ratings and demonstrate the feasibility of new computational approaches to scaling up the evaluation of behavioral treatments.

[1]  David C. Atkins,et al.  Randomized controlled trial of a Spring Break intervention to reduce high-risk drinking. , 2014, Journal of consulting and clinical psychology.

[2]  David C. Atkins,et al.  A randomized controlled trial of event-specific prevention strategies for reducing problematic drinking associated with 21st birthday celebrations. , 2012, Journal of consulting and clinical psychology.

[3]  Panayiotis G. Georgiou,et al.  "That's Aggravating, Very Aggravating": Is It Possible to Classify Behaviors in Couple Interactions Using Automatically Derived Lexical Features? , 2011, ACII.

[4]  R. Longabaugh.  The search for mechanisms of change in behavioral treatments for alcohol use disorders: a commentary. , 2007, Alcoholism, clinical and experimental research.

[5]  C. Porter,et al.  Motivational interviewing to support antiretroviral therapy adherence: the role of quality counseling. , 2006, Patient education and counseling.

[6]  Sean J. Tollison,et al.  Questions and reflections: the use of motivational interviewing microskills in a peer-led brief alcohol intervention for college students. , 2008, Behavior therapy.

[7]  D. Detmer.  American Medical Informatics Association (AMIA) 2007 Annual Symposium , 2008 .

[8]  J. Tonigan,et al.  The search for mechanisms of behavior change in evidence-based behavioral treatments for alcohol use disorders: overview. , 2007, Alcoholism, clinical and experimental research.

[9]  J. McKay.  Lessons learned from psychotherapy research. , 2007, Alcoholism, clinical and experimental research.

[10]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[11]  Jon M. Houck,et al.  CACTI: Free, Open-Source Software for the Sequential Coding of Behavioral Interactions , 2012, PloS one.

[12]  Özlem Uzuner,et al.  Three Approaches to Automatic Assignment of ICD-9-CM Codes to Radiology Reports , 2007, AMIA.

[13]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[14]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[15]  Shrikanth S. Narayanan,et al.  Combining lexical, syntactic and prosodic cues for improved online dialog act tagging , 2009, Comput. Speech Lang..

[16]  David C. Atkins,et al.  Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification , 2014, Implementation Science.

[17]  Max Kuhn,et al.  Applied Predictive Modeling , 2013 .

[18]  Koby Crammer,et al.  Automatic Code Assignment to Medical Text , 2007, BioNLP@ACL.

[19]  David C. Atkins,et al.  Brief intervention for problem drug use in safety-net primary care settings: a randomized clinical trial. , 2014, JAMA.

[20]  G. Tober.  Motivational Interviewing: Helping People Change , 2013 .

[21]  Andrew McCallum,et al.  Maximum Entropy Markov Models for Information Extraction and Segmentation , 2000, ICML.

[22]  M. Ogihara,et al.  Blending Qualitative and Computational Linguistics Methods for Fidelity Assessment: Experience with the Familias Unidas Preventive Intervention , 2015, Administration and Policy in Mental Health and Mental Health Services Research.

[23]  Jasjit S. Ahluwalia,et al.  Assessing the integrity of motivational interviewing interventions: Reliability of the motivational interviewing skills code , 2003 .

[24]  Michael,et al.  Affective Computing and Intelligent Interaction , 2011, Lecture Notes in Computer Science.

[25]  Matthew K Nock,et al.  Conceptual and design essentials for evaluating mechanisms of change. , 2007, Alcoholism, clinical and experimental research.

[26]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[27]  Antoinette Krupski,et al.  Testing the effects of brief intervention in primary care for problem drug use in a randomized controlled trial: rationale, design, and methods , 2012, Addiction Science & Clinical Practice.

[28]  Brian Borsari,et al.  The technical hypothesis of motivational interviewing: a meta-analysis of MI's key causal model. , 2014, Journal of consulting and clinical psychology.

[29]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.