Automated Prediction of Extraversion During Human–Humanoid Interaction

One of the most important challenges in robotics is to achieve natural and engaging interactions between humans and robots. Interpersonal interaction, the process by which two or more people exchange information through verbal and nonverbal messages, could be exploited by robots both to establish interaction and to inform about its quality. The production of social signals being influenced by individual factors, such as personality traits, is critical for robots to have personalized models of interaction. This paper focuses on estimating social traits such as human personality from the dynamics of interpersonal interaction. The work was carried out in the framework of the project engagement during human–humanoid interaction which focuses on understanding individual factors influencing joint human–humanoid actions. In particular, this work addresses the automated prediction of the Extraversion trait during a human–humanoid interaction. We show how it is possible to take into account the specificity of human–robot interaction scenarios by contextualizing personality through the attitude that participants show towards the robots. This attitude is influenced by the a priori knowledge that people have on social robotics, and their prior anxiety in interacting with them. The proposed model exploits a set of nonverbal features chosen according to literature in Psychology and Personality Computing. These features are adopted to characterize human behaviors and the dynamics of human–robot interaction. Experimental results highlight that it possible to predict Extraversion of the human partner from nonverbal behavior during human–robot interaction with an accuracy of 62%. A higher accuracy, 70%, is obtained from the computational model by explicitly combining the dynamics of interpersonal interaction and the attitude of the participants towards the robots. Results show that 120 s are needed to obtain such performance.

[1]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[2]  R. Ryckman,et al.  Theories of personality, 7th ed. , 2000 .

[3]  N. Ambady,et al.  Half a minute: Predicting teacher evaluations from thin slices of nonverbal behavior and physical attractiveness. , 1993 .

[4]  F. Hara,et al.  Use of face robot for human-computer communication , 1995, 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century.

[5]  Giulio Sandini,et al.  Force feedback exploiting tactile and proximal force/torque sensing , 2012, Autonomous Robots.

[6]  Rachid Alami,et al.  Visuo-Spatial Ability, Effort and Affordance Analyses: Towards Building Blocks for Robot's Complex Socio-Cognitive Behaviors , 2012, CogRob@AAAI.

[7]  A. Furnham,et al.  Personality and speech production: a pilot study of second language learners , 2000 .

[8]  Maria Teresa Lazaro,et al.  Personalized Short-Term Multi-modal Interaction for Social Robots Assisting Users in Shopping Malls , 2015, ICSR.

[9]  R Quian Quiroga,et al.  Event synchronization: a simple and fast method to measure synchronicity and time delay patterns. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  Alex Pentland,et al.  Human computing and machine understanding of human behavior: a survey , 2006, ICMI '06.

[11]  Philippe Gaussier,et al.  Robots Learn to Recognize Individuals from Imitative Encounters with People and Avatars , 2016, Scientific Reports.

[12]  Y. Iizuka Extraversion, Introversion, and Visual Interaction , 1992, Perceptual and motor skills.

[13]  P. Vernon,et al.  Some Characteristics of the Good Judge of Personality , 1933 .

[14]  Frank J. Bernieri,et al.  Interpersonal coordination: Behavior matching and interactional synchrony. , 1991 .

[15]  Emanuele Menegatti,et al.  Towards Partners Profiling in Human Robot Interaction Contexts , 2012, SIMPAR.

[16]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .

[17]  K. Dautenhahn Robots we like to live with?! - a developmental perspective on a personalized, life-long robot companion , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[18]  Sarah N. Woods,et al.  Are robots like people?: Relationships between participant and robot personality traits in human–robot interaction studies , 2007 .

[19]  Antonio Camurri,et al.  Interactive Systems Design: A KANSEI based Approach , 2002, NIME.

[20]  Sean Andrist,et al.  Look Like Me: Matching Robot Personality via Gaze to Increase Motivation , 2015, CHI.

[21]  Robert R. McCrae,et al.  The Cambridge Handbook of Personality Psychology: The Five-Factor Model of personality traits: consensus and controversy , 2009 .

[22]  K. M. Lee,et al.  Can robots manifest personality? : An empirical test of personality recognition, social responses, and social presence in human-robot interaction , 2006 .

[23]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Mohamed Chetouani,et al.  Robot initiative in a team learning task increases the rhythm of interaction but not the perceived engagement , 2014, Front. Neurorobot..

[25]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[26]  Alessandro Vinciarelli,et al.  A Survey of Personality Computing , 2014, IEEE Transactions on Affective Computing.

[27]  Gordon W. Allport,et al.  Pattern and growth in personality , 1961 .

[28]  Giulio Sandini,et al.  The iCub Platform: A Tool for Studying Intrinsically Motivated Learning , 2013, Intrinsically Motivated Learning in Natural and Artificial Systems.

[29]  F. Thomas,et al.  The illusion of life : Disney animation , 1981 .

[30]  Nicu Sebe,et al.  Please, tell me about yourself: automatic personality assessment using short self-presentations , 2011, ICMI '11.

[31]  Fehr,et al.  Introduction to Personality , 1983 .

[32]  P. Costa,et al.  A contemplated revision of the NEO Five-Factor Inventory , 2004 .

[33]  Raymond H. Cuijpers,et al.  Creating Robots with Personality: The Effect of Personality on Social Intelligence , 2015, IWINAC.

[34]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[35]  Mohamed Chetouani,et al.  Trust as indicator of robot functional and social acceptance. An experimental study on user conformation to iCub answers , 2015, Comput. Hum. Behav..

[36]  Mohamed Chetouani,et al.  SyncPy: a Unified Open-source Analytic Library for Synchrony , 2015, INTERPERSONAL@ICMI.

[37]  John F. Kihlstrom,et al.  Personality and social intelligence , 1987 .

[38]  ChetouaniMohamed,et al.  Trust as indicator of robot functional and social acceptance. An experimental study on user conformation to iCub answers , 2016 .

[39]  Kerstin Dautenhahn,et al.  The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop , 1998, Appl. Artif. Intell..

[40]  Sofiane Boucenna,et al.  Evaluating the Engagement with Social Robots , 2015, International Journal of Social Robotics.

[41]  Adriana Tapus,et al.  Socially Assistive Robots: The Link between Personality, Empathy, Physiological Signals, and Task Performance , 2008, AAAI Spring Symposium: Emotion, Personality, and Social Behavior.

[42]  P. H. Lodhi,et al.  The Five-Factor Model of Personality , 2002 .

[43]  Takayuki Kanda,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 2 , 2022 .

[44]  Peter Robinson,et al.  Cooperative gestures: Effective signaling for humanoid robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[45]  Lin Qiu,et al.  You are what you tweet: Personality expression and perception on Twitter , 2012 .

[46]  Dirk Heylen,et al.  Bridging the Gap between Social Animal and Unsocial Machine: A Survey of Social Signal Processing , 2012, IEEE Transactions on Affective Computing.

[47]  Mohamed Chetouani,et al.  Predicting Extraversion from Non-verbal Features During a Face-to-Face Human-Robot Interaction , 2015, ICSR.

[48]  Adriana Tapus,et al.  A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[49]  Bernard Rimé,et al.  Fundamentals of nonverbal behavior , 1991 .

[50]  I. Ajzen Attitudes, Personality and Behavior , 1988 .

[51]  Christoph Bartneck,et al.  Iterative design process for robots with personality , 2009 .

[52]  John L. Williams Personal space and its relation to extraversion-introversion. , 1971 .

[53]  Daniel Gatica-Perez,et al.  The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs , 2013, IEEE Transactions on Multimedia.

[54]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[55]  Philippe Gaussier,et al.  Intuitive human robot interaction based on unintentional synchrony: A psycho-experimental study , 2013, 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[56]  Hatice Gunes,et al.  Fully Automatic Analysis of Engagement and Its Relationship to Personality in Human-Robot Interactions , 2017, IEEE Access.

[57]  Adam J. Sporka,et al.  Recognition of Personality Traits from Human Spoken Conversations , 2011, INTERSPEECH.

[58]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[59]  Mohamed Chetouani,et al.  Towards Engagement Models that Consider Individual Factors in HRI: On the Relation of Extroversion and Negative Attitude Towards Robots to Gaze and Speech During a Human–Robot Assembly Task , 2015, Int. J. Soc. Robotics.

[60]  杨文秀,et al.  此处“personality”译法探析 , 2000 .

[61]  R. Lippa The Nonverbal Display and Judgment of Extraversion, Masculinity, Femininity, and Gender Diagnosticity: A Lens Model Analysis , 1998 .

[62]  F. Pampel Logistic Regression: A Primer , 2000 .

[63]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[64]  В С Кашпарова,et al.  О построении новых психометрических шкал на основе многошкального личностного опросника neo PI-R , 2013 .

[65]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[66]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[67]  R. Lippa,et al.  The Relation of Gender, Personality, and Intelligence to Judges' Accuracy in Judging Strangers' Personality From Brief Video Segments , 2000 .

[68]  Elisa Ricci,et al.  Space speaks: towards socially and personality aware visual surveillance , 2010, MPVA '10.

[69]  Tatsuya Nomura,et al.  Experimental investigation into influence of negative attitudes toward robots on human–robot interaction , 2006, AI & SOCIETY.

[70]  P. Costa,et al.  Revised NEO Personality Inventory (NEO-PI-R) and NEO-Five-Factor Inventory (NEO-FFI) , 1992 .

[71]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[72]  Kerstin Dautenhahn,et al.  In Good Company? Perception of Movement Synchrony of a Non-Anthropomorphic Robot , 2015, PloS one.

[73]  G. Lindzey,et al.  Theories of Personality , 1958 .

[74]  Mohamed Chetouani,et al.  Interpersonal Synchrony: A Survey of Evaluation Methods across Disciplines , 2012, IEEE Transactions on Affective Computing.

[75]  Vanessa Evers,et al.  What you do is who you are: The role of task context in perceived social robot personality , 2013, 2013 IEEE International Conference on Robotics and Automation.