Interlocutor personality perception based on BFI profiles and coupled HMMs in a dyadic conversation

Previous studies have found systematic associations between personality and individual differences in interpersonal communication. Recently, researchers used various features to analyze individual personality traits in speech, social media content and essays. While few studies focused on detecting the personality interaction between two interlocutors, this paper presents a new approach to automatically and simultaneously predict the personalities of two interlocutors in a dyadic conversation. First, the recurrent neural networks (RNNs) are adopted to project the linguistic features of the transcribed spoken text of the input speech to the Big Five Inventory (BFI) space. The Coupled hidden Markov models (coupled HMMs) are then used to predict the interlocutor personality from the transcribed text of the two speakers considering the conversational interaction in their dialogue turns. The Mandarin Conversational Dialogue Corpus (MCDC) was adopted to evaluate the performance on interlocutor personality perception. Experimental results show that the proposed approach achieved satisfactory results in predicting personalities of two interlocutors at the same time.

[1]  Alessandro Vinciarelli,et al.  Automatic Personality Perception: Prediction of Trait Attribution Based on Prosodic Features , 2012, IEEE Transactions on Affective Computing.

[2]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[3]  Yuan Yao,et al.  A Weighted ML-KNN Model for Predicting Users’Personality Traits , 2013, ISCA 2013.

[4]  Alessandro Vinciarelli,et al.  Automatic recognition of personality and conflict handling style in mobile phone conversations , 2013, 2013 14th International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS).

[5]  Lin Li,et al.  Improving user profile with personality traits predicted from social media content , 2013, RecSys.

[6]  Nianjun Liu,et al.  Using Coupled Hidden Markov Models to Model Suspect Interactions in Digital Forensic Analysis , 2006, 2006 International Workshop on Integrating AI and Data Mining.

[7]  Chung-Hsien Wu,et al.  Exploiting Psychological Factors for Interaction Style Recognition in Spoken Conversation , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[8]  Kwang Y. Lee,et al.  Diagonal recurrent neural networks for dynamic systems control , 1995, IEEE Trans. Neural Networks.

[9]  Mark Beale,et al.  Neural Network Toolbox™ User's Guide , 2015 .

[10]  Tim Polzehl,et al.  On Speaker-Independent Personality Perception and Prediction from Speech , 2012, INTERSPEECH.

[11]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[12]  M. Walker,et al.  Words Mark the Nerds: Computational Models of Personality Recognition through Language , 2006 .

[13]  Cindy K. Chung,et al.  The development of the Chinese linguistic inquiry and word count dictionary. , 2012 .

[14]  H. Lundstedt,et al.  Prediction of geomagnetic storms from solar wind data using Elman Recurrent Neural Networks , 1996 .

[15]  Chung-Hsien Wu,et al.  Emotion Recognition of Affective Speech Based on Multiple Classifiers Using Acoustic-Prosodic Information and Semantic Labels , 2015, IEEE Transactions on Affective Computing.

[16]  Michal Kosinski,et al.  Mining Facebook Data for Predictive Personality Modeling , 2013, Proceedings of the International AAAI Conference on Web and Social Media.

[17]  J. Burgoon,et al.  Interpersonal Adaptation: Dyadic Interaction Patterns , 1995 .

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Carlos Busso,et al.  Modeling mutual influence of interlocutor emotion states in dyadic spoken interactions , 2009, INTERSPEECH.

[20]  Tim Polzehl,et al.  Automatically Assessing Personality from Speech , 2010, 2010 IEEE Fourth International Conference on Semantic Computing.

[21]  WuChung-Hsien,et al.  Emotion recognition from text using semantic labels and separable mixture models , 2006 .

[22]  C. Judd,et al.  Fundamental dimensions of social judgment: understanding the relations between judgments of competence and warmth. , 2005, Journal of personality and social psychology.

[23]  Jennifer Golbeck,et al.  Predicting Personality from Twitter , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.