Multimodal recognition of personality traits in human-computer collaborative tasks

The user's personality in Human-Computer Interaction (HCI) plays an important role for the overall success of the interaction. The present study focuses on automatically recognizing the Big Five personality traits from 2-5 min long videos, in which the computer interacts using different levels of collaboration, in order to elicit the manifestation of these personality traits. Emotional Stability and Extraversion are the easiest traits to automatically detect under the different collaborative settings: all the settings for Emotional Stability and intermediate and fully-non collaborative settings for Extraversion. Interestingly, Agreeableness and Conscientiousness can be detected only under a moderately non-collaborative setting. Finally, our task does not seem to activate the full range of dispositions for Creativity.

[1]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[2]  P. Borkenau,et al.  Trait inferences: Sources of validity at zero acquaintance. , 1992 .

[3]  Alessandro Vinciarelli,et al.  The voice of personality: mapping nonverbal vocal behavior into trait attributions , 2010, SSPW '10.

[4]  Julia Hirschberg,et al.  Classifying subject ratings of emotional speech using acoustic features , 2003, INTERSPEECH.

[5]  M. Davies,et al.  Approximating optical flow within the MPEG-2 compressed domain , 2005 .

[6]  Nicu Sebe,et al.  Please, tell me about yourself: automatic personality assessment using short self-presentations , 2011, ICMI '11.

[7]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[8]  Alessandro Vinciarelli,et al.  Automatic personality perception: Prediction of trait attribution based on prosodic features extended abstract , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[9]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[10]  M. Perugini,et al.  The Big Five Marker Scales (BFMS) and the Italian AB5C taxonomy: Analyses from an emic-etic perspective , 2002 .

[11]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[12]  Hiroshi Nakajima,et al.  The functionality of human-machine collaboration systems - mind model and social behavior , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[13]  Chuohao Yeo,et al.  Compressed domain video processing of meetings for activity estimation in dominance classification and slide transition detection , 2008 .

[14]  J. Pennebaker,et al.  LEXICAL PREDICTORS OFPERSONALITY TYPE , 2005 .

[15]  Anne H. Anderson,et al.  The Hcrc Map Task Corpus , 1991 .

[16]  Cristiano Castelfranchi,et al.  How Can Personali ty Factors Contr ibute to Make Agents More ‘ Believable ’ ? , 2007 .

[17]  W. Fleeson.  Toward a structure- and process-integrated view of personality: traits as density distribution of states. , 2001, Journal of personality and social psychology.

[18]  Jon Oberlander,et al.  Whose Thumb Is It Anyway? Classifying Author Personality from Weblog Text , 2006, ACL.

[19]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[20]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[21]  Nadia Mana,et al.  Modeling the Personality of Participants During Group Interactions , 2009, UMAP.

[22]  A. Furnham.  Language and personality. , 1990 .

[23]  R. Riggio,et al.  Impression formation: the role of expressive behavior. , 1986, Journal of personality and social psychology.

[24]  M. Ashton,et al.  A theoretical basis for the major dimensions of personality , 2001 .

[25]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[26]  Paul Boersma,et al.  Praat, a system for doing phonetics by computer , 2002 .

[27]  Fabio Pianesi,et al.  Multimodal recognition of personality during short self-presentations , 2011, J-HGBU '11.

[28]  D. Feil-Seifer,et al.  Defining socially assistive robotics , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[29]  Marilyn A. Walker,et al.  Automatic Recognition of Personality in Conversation , 2006, NAACL.

[30]  Steve Young,et al.  The HTK book version 3.4 , 2006 .

[31]  A. Furnham,et al.  Personality and speech production: a pilot study of second language learners , 2000 .

[32]  Thomas Rist,et al.  Integrating Models of Personality and Emotions into Lifelike Characters , 1999, IWAI.

[33]  M. Walker,et al.  Words Mark the Nerds: Computational Models of Personality Recognition through Language , 2006 .

[34]  Michael Kipp,et al.  ANVIL - a generic annotation tool for multimodal dialogue , 2001, INTERSPEECH.

[35]  J. Brebner.  Personality theory and movement , 1985 .

[36]  M. Ashton,et al.  What is the central feature of extraversion? Social attention versus reward sensitivity. , 2002, Journal of personality and social psychology.

[37]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[38]  Nicu Sebe,et al.  The SocioMetric Badges Corpus: A Multilevel Behavioral Dataset for Social Behavior in Complex Organizations , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.