What an “Ehm” Leaks About You: Mapping Fillers into Personality Traits with Quantum Evolutionary Feature Selection Algorithms

This work shows that fillers - short utterances like "ehm" and "uhm" - allow one to predict whether someone is above median along the Big-Five personality traits. The experiments have been performed over a corpus of 2,988 fillers uttered by 120 different speakers in spontaneous conversations. The results show that the prediction accuracies range between 74% and 82% depending on the particular trait. The proposed approach includes a feature selection step - based on Quantum Evolutionary Algorithms - that has been used to detect the personality markers, i.e., the subset of the features that better account for the prediction outcomes and, indirectly, for the personality of the speakers. The results show that only a relatively few features tend to be consistently selected, thus acting as reliable personality markers.

[1]  Magdalene Marinaki,et al.  A bumble bees mating optimization algorithm for the feature selection problem , 2016, Int. J. Mach. Learn. Cybern..

[2]  Dimitra Vergyri,et al.  Multi-System Fusion of Extended Context Prosodic and Cepstral Features for Paralinguistic Speaker Trait Classification , 2012, INTERSPEECH.

[3]  Adam Prügel-Bennett,et al.  Anatomy of the fitness landscape for dense graph-colouring problem , 2015, Swarm Evol. Comput..

[4]  Anil K. Jain,et al.  Artificial Neural Networks: A Tutorial , 1996, Computer.

[5]  Mengjie Zhang,et al.  Salient object detection using learning classifiersystems that compute action mappings , 2014, GECCO.

[6]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[7]  Fabio Pianesi,et al.  A multimodal annotated corpus of consensus decision making meetings , 2007, Lang. Resour. Evaluation.

[8]  Anna Esposito,et al.  When the Words are Not Everything: The Use of Laughter, Fillers, Back-Channel, Silence, and Overlapping Speech in Phone Calls , 2015, Front. ICT.

[9]  G. Tottie Uh and Um as sociolinguistic markers in British English , 2011 .

[10]  Zhiyong Zeng,et al.  Feature Selection Based on Dependency Margin , 2015, IEEE Transactions on Cybernetics.

[11]  Jong-Hwan Kim,et al.  Quantum-inspired evolutionary algorithm for a class of combinatorial optimization , 2002, IEEE Trans. Evol. Comput..

[12]  Matthew P. Aylett,et al.  Speech Synthesis for the Generation of Artificial Personality , 2020, IEEE Transactions on Affective Computing.

[13]  Adam J. Sporka,et al.  Recognition of Personality Traits from Human Spoken Conversations , 2011, INTERSPEECH.

[14]  C. Ken Weidner,et al.  Experiential Learning Process: Exploring Teaching and Learning of Strategic Management Framework through the Winter Survival Exercise , 2005 .

[15]  I. Deary,et al.  Personality Traits: Alternative views of personality: challenges to trait theory , 2009 .

[16]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[17]  Nadia Mana,et al.  Multimodal recognition of personality traits in human-computer collaborative tasks , 2012, ICMI '12.

[18]  Jack Sklansky,et al.  A note on genetic algorithms for large-scale feature selection , 1989, Pattern Recognit. Lett..

[19]  Adam Prügel-Bennett,et al.  On the Landscape of Combinatorial Optimisation Problems , 2012 .

[20]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[21]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[22]  Alper Ekrem Murat,et al.  A discrete particle swarm optimization method for feature selection in binary classification problems , 2010, Eur. J. Oper. Res..

[23]  Jannica Heinström,et al.  Five personality dimensions and their influence on information behaviour , 2003, Inf. Res..

[24]  Jurij F. Tasic,et al.  Affective Labeling in a Content-Based Recommender System for Images , 2013, IEEE Transactions on Multimedia.

[25]  Marko Tkalcic,et al.  Using affective parameters in a content-based recommender system for images , 2010, User Modeling and User-Adapted Interaction.

[26]  Zhong Yan,et al.  Ant Colony Optimization for Feature Selection in Face Recognition , 2004, ICBA.

[27]  Fabio Pianesi,et al.  The Workshop on Computational Personality Recognition 2014 , 2014, ACM Multimedia.

[28]  Alessandro Vinciarelli,et al.  A Survey of Personality Computing , 2014, IEEE Transactions on Affective Computing.

[29]  Elmar Nöth,et al.  A Survey on perceived speaker traits: Personality, likability, pathology, and the first challenge , 2015, Comput. Speech Lang..

[30]  Larry V. Hedges,et al.  Correcting a Significance Test for Clustering , 2007 .

[31]  Robert Rosenthal,et al.  Conducting Judgment Studies , 2008 .

[32]  Alessandro Vinciarelli,et al.  Automatic personality perception: Prediction of trait attribution based on prosodic features extended abstract , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[33]  E. Sapir Speech as a Personality Trait , 1927, American Journal of Sociology.

[34]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[35]  Nikhil R. Pal,et al.  Genetic programming for simultaneous feature selection and classifier design , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[36]  Fabio Valente,et al.  Annotation and Recognition of Personality Traits in Spoken Conversations from the AMI Meetings Corpus , 2012, INTERSPEECH.

[37]  Nicu Sebe,et al.  Please, tell me about yourself: automatic personality assessment using short self-presentations , 2011, ICMI '11.

[38]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[39]  Fawaz S. Al-Anzi,et al.  The Capacity of Mel Frequency Cepstral Coefficients for Speech Recognition , 2017 .

[40]  Christian Lebiere,et al.  The Cascade-Correlation Learning Architecture , 1989, NIPS.

[41]  Lawrence R. Rabiner,et al.  A pattern recognition approach to voiced-unvoiced-silence classification with applications to speech recognition , 1976 .

[42]  van de Mortel,et al.  Faking it: Social desirability response bias in self-report research , 2008 .

[43]  Björn Schuller,et al.  Computational Paralinguistics , 2013 .

[44]  Subramanian Ramanathan,et al.  Connecting Meeting Behavior with Extraversion—A Systematic Study , 2012, IEEE Transactions on Affective Computing.

[45]  O. John,et al.  Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German , 2007 .

[46]  Okko Johannes Räsänen,et al.  Feature Selection for Speaker Traits , 2012, INTERSPEECH.

[47]  Antonio Origlia,et al.  From speech to personality: mapping voice quality and intonation into personality differences , 2012, ACM Multimedia.

[48]  Joseph P. Olive,et al.  Formant tracking using context-dependent phonemic information , 2005, IEEE Transactions on Speech and Audio Processing.

[49]  K. Scherer Personality inference from voice quality: The loud voice of extroversion. , 1978 .

[50]  Eric O. Postma,et al.  The log-Gabor method: speech classification using spectrogram image analysis , 2012, INTERSPEECH.

[51]  J. Pennebaker,et al.  Um . . . Who Like Says You Know , 2014 .

[52]  Björn Schuller,et al.  Opensmile: the munich versatile and fast open-source audio feature extractor , 2010, ACM Multimedia.

[53]  Marilyn A. Walker,et al.  Using Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text , 2007, J. Artif. Intell. Res..

[54]  A. Feingold,et al.  Gender differences in personality: a meta-analysis. , 1994, Psychological bulletin.

[55]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[56]  Johannes Wagner,et al.  A Frame Pruning Approach for Paralinguistic Recognition Tasks , 2012, INTERSPEECH.

[57]  Andreas Wendemuth,et al.  Companion-Technology for Cognitive Technical Systems , 2016, KI - Künstliche Intelligenz.

[58]  Huan Liu,et al.  Feature Selection: An Ever Evolving Frontier in Data Mining , 2010, FSDM.

[59]  Zexuan Zhu,et al.  Markov blanket-embedded genetic algorithm for gene selection , 2007, Pattern Recognit..

[60]  J. Buckley,et al.  Fuzzy neural networks: a survey , 1994 .

[61]  Adam Prügel-Bennett,et al.  Quadratic assignment problem: a landscape analysis , 2015, Evol. Intell..

[62]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[63]  Fabio Pianesi,et al.  Workshop on Computational Personality Recognition: Shared Task , 2013, Proceedings of the International AAAI Conference on Web and Social Media.

[64]  Laurence Devillers,et al.  Personality traits detection using a parallelized modified SFFS algorithm , 2012, INTERSPEECH.

[65]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[66]  Claude Montacié,et al.  Pitch and Intonation Contribution to Speakers' Traits Classification , 2012, INTERSPEECH.

[67]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[68]  Pierre Dumouchel,et al.  Anchor Models and WCCN Normalization For Speaker Trait Classification , 2012, INTERSPEECH.

[69]  Angeliki Metallinou,et al.  Speaker Personality Classification Using Systems Based on Acoustic-Lexical Cues and an Optimal Tree-Structured Bayesian Network , 2012, INTERSPEECH.

[70]  M. Duff,et al.  Acute stress reduces speech fluency , 2014, Biological Psychology.

[71]  L. Clark,et al.  Extraversion and Its Positive Emotional Core , 1997 .

[72]  H. H. Clark,et al.  Using uh and um in spontaneous speaking , 2002, Cognition.

[73]  Adam Prügel-Bennett,et al.  An Analysis of the Fitness Landscape of Travelling Salesman Problem , 2016, Evolutionary Computation.

[74]  Andreas Christmann,et al.  Support vector machines , 2008, Data Mining and Knowledge Discovery Handbook.

[75]  Mohammad-R. Akbarzadeh-T,et al.  Improvement of the performance of the Quantum-inspired Evolutionary Algorithms: structures, population, operators , 2014, Evol. Intell..

[76]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[77]  Tim Polzehl,et al.  On Speaker-Independent Personality Perception and Prediction from Speech , 2012, INTERSPEECH.

[78]  M. Walker,et al.  Words Mark the Nerds: Computational Models of Personality Recognition through Language , 2006 .

[79]  Fabio Valente,et al.  The INTERSPEECH 2013 computational paralinguistics challenge: social signals, conflict, emotion, autism , 2013, INTERSPEECH.

[80]  Björn W. Schuller,et al.  Recent developments in openSMILE, the munich open-source multimedia feature extractor , 2013, ACM Multimedia.

[81]  Peter Harms,et al.  An evaluation of the consequences of using short measures of the Big Five personality traits. , 2012, Journal of personality and social psychology.

[82]  D. Hagemann,et al.  Extraversion and its positive emotional core , 2011 .

[83]  Adel Al-Jumaily,et al.  A Combined Ant Colony and Differential Evolution Feature Selection Algorithm , 2008, ANTS Conference.

[84]  L. R. Goldberg,et al.  The language of personality: Lexical perspectives on the five-factor model. , 1996 .

[85]  Alexei V. Ivanov,et al.  Modulation Spectrum Analysis for Speaker Personality Trait Recognition , 2012, INTERSPEECH.

[86]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[87]  Qiang Ji,et al.  Video Affective Content Analysis: A Survey of State-of-the-Art Methods , 2015, IEEE Transactions on Affective Computing.

[88]  Yphtach Lelkes,et al.  Selling Ourselves Short? How Abbreviated Measures of Personality Change the Way We Think about Personality and Politics , 2018, The Journal of Politics.

[89]  Huan Liu,et al.  Manipulating Data and Dimension Reduction Methods: Feature Selection , 2009, Encyclopedia of Complexity and Systems Science.