Behavioral Coding of Therapist Language in Addiction Counseling Using Recurrent Neural Networks

Manual annotation of human behaviors with domain specific codes is a primary method of research and treatment fidelity evaluation in psychotherapy. However, manual annotation has a prohibitively high cost and does not scale to coding large amounts of psychotherapy session data. In this paper, we present a case study of modeling therapist language in addiction counseling, and propose an automatic coding approach. The task objective is to code therapist utterances with domain specific codes. We employ Recurrent Neural Networks (RNNs) to predict these behavioral codes based on session transcripts. Experiments show that RNNs outperform the baseline method using Maximum Entropy models. The model with bi-directional Gated Recurrent Units and domain specific word embeddings achieved the highest overall accuracy. We also briefly discuss about client code prediction and comparison to previous work.

[1]  Padhraic Smyth,et al.  Recursive Neural Networks for Coding Therapist and Patient Behavior in Motivational Interviewing , 2015, CLPsych@HLT-NAACL.

[2]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[3]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[4]  G. Tober.  Motivational Interviewing: Helping People Change , 2013 .

[5]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[6]  David C. Atkins,et al.  Computational psychotherapy research: scaling up the evaluation of patient-provider interactions. , 2015, Psychotherapy.

[7]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[8]  Bryan Hartzler,et al.  Agency context and tailored training in technology transfer: a pilot evaluation of motivational interviewing training for community counselors. , 2009, Journal of substance abuse treatment.

[9]  Che-Wei Huang,et al.  Distributed under Creative Commons Cc-by 4.0 a Technology Prototype System for Rating Therapist Empathy from Audio Recordings in Addiction Counseling , 2022 .

[10]  Andrew W. Senior,et al.  Long short-term memory recurrent neural network architectures for large scale acoustic modeling , 2014, INTERSPEECH.

[11]  David C. Atkins,et al.  A Comparison of Natural Language Processing Methods for Automated Coding of Motivational Interviewing. , 2016, Journal of substance abuse treatment.

[12]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[13]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[14]  Stacey M. L. Hendrickson,et al.  Assessing competence in the use of motivational interviewing. , 2005, Journal of substance abuse treatment.

[15]  Zhang Le,et al.  Maximum Entropy Modeling Toolkit for Python and C , 2004 .

[16]  Panayiotis G. Georgiou,et al.  A Case Study: Detecting Counselor Reflections in Psychotherapy for Addictions using Linguistic Features , 2012, INTERSPEECH.

[17]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[18]  Shrikanth S. Narayanan,et al.  "Rate My Therapist": Automated Detection of Empathy in Drug and Alcohol Counseling via Speech and Language Processing , 2015, PloS one.

[19]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[20]  References , 1971 .

[21]  David C. Atkins,et al.  Scaling up the evaluation of psychotherapy: evaluating motivational interviewing fidelity via statistical text classification , 2014, Implementation Science.

[22]  Ronald Rosenfeld,et al.  A maximum entropy approach to adaptive statistical language modelling , 1996, Comput. Speech Lang..

[23]  Shrikanth S. Narayanan,et al.  A dialog act tagging approach to behavioral coding: a case study of addiction counseling conversations , 2015, INTERSPEECH.

[24]  W. Miller,et al.  Toward a theory of motivational interviewing. , 2009, The American psychologist.

[25]  Petr Sojka,et al.  Software Framework for Topic Modelling with Large Corpora , 2010 .

[26]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[27]  Andreas Stolcke,et al.  Recurrent neural network and LSTM models for lexical utterance classification , 2015, INTERSPEECH.

[28]  Allen Zweben,et al.  Sustaining motivational interviewing: a meta-analysis of training studies. , 2014, Addiction.