Redundancy analysis of behavioral coding for couples therapy and improved estimation of behavior from noisy annotations

Assessment and quantification of behavior is an important research objective in the recently developed field of behavioral signal processing. This paper focuses on the estimation of behavior from noisy human assessment. It aims to address the redundancy of behavioral descriptors for couples therapy by introducing a lower-dimensional representation of the behavioral space. We present an improved method for estimating the ground truth of behavioral ratings from assessment by multiple experts or annotators. The results show improved estimation performance using the proposed method and provide an insightful analysis of reconstruction error and decorrelation of annotator bias in the reduced behavioral space.

[1]  References , 1971 .

[2]  Panayiotis G. Georgiou,et al.  Analyzing the language of therapist empathy in Motivational Interview based psychotherapy , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[3]  Nora A. Murphy,et al.  Using Thin Slices for Behavioral Coding , 2005 .

[4]  Gerardo Hermosillo,et al.  Learning From Crowds , 2010, J. Mach. Learn. Res..

[5]  Shrikanth S. Narayanan,et al.  Primitives-based evaluation and estimation of emotions in speech , 2007, Speech Commun..

[6]  Athanasios Katsamanis,et al.  Automatic classification of married couples' behavior using audio features , 2010, INTERSPEECH.

[7]  Tessa V. West,et al.  Behavioral observation and coding , 2014 .

[8]  Brian R. Baucom,et al.  A behaviorist manifesto for the 21st century , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[9]  Klaus Krippendorff,et al.  Estimating the Reliability, Systematic Error and Random Error of Interval Data , 1970 .

[10]  Rahul Gupta,et al.  Predicting client's inclination towards target behavior change in motivational interviewing and investigating the role of laughter , 2014, INTERSPEECH.

[11]  Harrison Si,et al.  Handbook of Research Methods in Social and Personality Psychology: Author Index , 2013 .

[12]  David C. Atkins,et al.  Traditional versus integrative behavioral couple therapy for significantly and chronically distressed married couples. , 2004, Journal of consulting and clinical psychology.

[13]  Shrikanth S. Narayanan,et al.  A Globally-Variant Locally-Constant Model for Fusion of Labels from Multiple Diverse Experts without Using Reference Labels , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  K. Kroschel,et al.  Evaluation of natural emotions using self assessment manikins , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[15]  Athanasios Katsamanis,et al.  Toward automating a human behavioral coding system for married couples' interactions using speech acoustic features , 2013, Speech Commun..

[16]  Panayiotis G. Georgiou,et al.  Behavioral Signal Processing: Deriving Human Behavioral Informatics From Speech and Language , 2013, Proceedings of the IEEE.

[17]  Pietro Perona,et al.  The Multidimensional Wisdom of Crowds , 2010, NIPS.

[18]  Shrikanth S. Narayanan,et al.  Using physiology and language cues for modeling verbal response latencies of children with ASD , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.