Automatically Classifying Self-Rated Personality Scores from Speech

Automatic personality recognition is useful for many computational applications, including recommendation systems, dating websites, and adaptive dialogue systems. There have been numerous successful approaches to classify the “Big Five” personality traits from a speaker’s utterance, but these have largely relied on judgments of personality obtained from external raters listening to the utterances in isolation. This work instead classifies personality traits based on self-reported personality tests, which are more valid and more difficult to identify. Our approach, which uses lexical and acoustic-prosodic features, yields predictions that are between 6.4% and 19.2% more accurate than chance. This approach predicts Opennessto-Experience and Neuroticism most successfully, with less accurate recognition of Extroversion. We compare the performance of classification and regression techniques, and also explore predicting personality clusters.

[1]  J. M. Digman PERSONALITY STRUCTURE: EMERGENCE OF THE FIVE-FACTOR MODEL , 1990 .

[2]  Alessandro Vinciarelli,et al.  A Survey of Personality Computing , 2014, IEEE Transactions on Affective Computing.

[3]  Ulrike Gretzel,et al.  Tell Me Who You Are and I Will Tell You Where to Go: Use of Travel Personalities in Destination Recommendation Systems , 2004, J. Inf. Technol. Tour..

[4]  M. Brent Donnellan,et al.  The Big Five and enduring marriages , 2004 .

[5]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[6]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001 .

[7]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[8]  C. Aronovitch The voice of personality: stereotyped judgments and their relation to voice quality and sex of speaker. , 1976, The Journal of social psychology.

[9]  Donald M. Taylor,et al.  Speech markers in social interaction , 1979 .

[10]  Fabio Valente,et al.  The INTERSPEECH 2013 computational paralinguistics challenge: social signals, conflict, emotion, autism , 2013, INTERSPEECH.

[11]  Björn W. Schuller,et al.  Recent developments in openSMILE, the munich open-source multimedia feature extractor , 2013, ACM Multimedia.

[12]  E. B. Mallory,et al.  A possible basis for the association of voice characteristics and personality traits , 1958 .

[13]  Jay Belsky,et al.  The relations between parents' Big Five personality factors and parenting: a meta-analytic review. , 2009, Journal of personality and social psychology.

[14]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[15]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[16]  Mattias Heldner,et al.  The fundamental frequency variation spectrum , 2008 .

[17]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[18]  P. Borkenau,et al.  Trait inferences: Sources of validity at zero acquaintance. , 1992 .

[19]  Alessandro Vinciarelli,et al.  The voice of personality: mapping nonverbal vocal behavior into trait attributions , 2010, SSPW '10.

[20]  J. Pennebaker,et al.  Lying Words: Predicting Deception from Linguistic Styles , 2003, Personality & social psychology bulletin.

[21]  Jonathan G. Fiscus,et al.  A post-processing system to yield reduced word error rates: Recognizer Output Voting Error Reduction (ROVER) , 1997, 1997 IEEE Workshop on Automatic Speech Recognition and Understanding Proceedings.

[22]  Martha E. Francis,et al.  Journal of Personality and Social Psychology Linguistic Predictors of Adaptive Bereavement , 2022 .

[23]  R. Robins,et al.  PERSONALITY PROCESSES AND INDIVIDUAL DIFFERENCES Personality Predictors of Academic Outcomes: Big Five Correlates of GPA and SAT Scores , 2007 .

[24]  S. Gosling,et al.  Personality in its natural habitat: manifestations and implicit folk theories of personality in daily life. , 2006, Journal of personality and social psychology.

[25]  E. L. Kelly,et al.  Personality and compatibility: a prospective analysis of marital stability and marital satisfaction. , 1987, Journal of personality and social psychology.

[26]  C. Nass,et al.  Does computer-synthesized speech manifest personality? Experimental tests of recognition, similarity-attraction, and consistency-attraction. , 2001, Journal of experimental psychology. Applied.

[27]  A. Kazdin Encyclopedia of psychology , 1984 .

[28]  G. Vaillant,et al.  The Big Five Personality Traits and the Life Course: A 45-Year Longitudinal Study , 1999 .

[29]  B. L. Brown Effects of Speech Rate on Personality Attributions and Competency Evaluations , 1980 .

[30]  Rong Hu,et al.  A Study on User Perception of Personality-Based Recommender Systems , 2010, UMAP.

[31]  Sarah Ita Levitan,et al.  Individual Differences in Deception and Deception Detection , 2015 .

[32]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[33]  C. Whissell,et al.  A Dictionary of Affect in Language: IV. Reliability, Validity, and Applications , 1986 .

[34]  Xiaodong Cui,et al.  Improving deep neural network acoustic modeling for audio corpus indexing under the IARPA babel program , 2014, INTERSPEECH.

[35]  J. Pennebaker,et al.  LEXICAL PREDICTORS OFPERSONALITY TYPE , 2005 .

[36]  Marilyn A. Walker,et al.  PERSONAGE: Personality Generation for Dialogue , 2007, ACL.

[37]  R. McCrae Trait psychology and culture: exploring intercultural comparisons. , 2001, Journal of personality.

[38]  W. Heller Neuropsychological mechanisms of individual differences in emotion, personality, and arousal. , 1993 .

[39]  Julia Hirschberg,et al.  Cross-Cultural Production and Detection of Deception from Speech , 2015, WMDD@ICMI.