A Robot’s Expressive Language Affects Human Strategy and Perceptions in a Competitive Game

As robots are increasingly endowed with social and communicative capabilities, they will interact with humans in more settings, both collaborative and competitive. We explore human-robot relationships in the context of a competitive Stackelberg Security Game. We vary humanoid robot expressive language (in the form of “encouraging” or “discouraging” verbal commentary) and measure the impact on participants’ rationality, strategy prioritization, mood, and perceptions of the robot. We learn that a robot opponent that makes discouraging comments causes a human to play a game less rationally and to perceive the robot more negatively. We also contribute a simple open source Natural Language Processing framework for generating expressive sentences, which was used to generate the speech of our autonomous social robot.

[1]  Rebecca Q. Stafford,et al.  Attitudes and reactions to a healthcare robot. , 2010, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[2]  R. McKelvey,et al.  Quantal Response Equilibria for Normal Form Games , 1995 .

[3]  Oliver Benjamin Conmy.  Trash Talk in a Competitive Setting , 2008 .

[4]  Ana Paiva,et al.  It's all in the game: Towards an affect sensitive and context aware game companion , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[5]  James C. Boerkoel,et al.  Human-Robot Trust and Cooperation Through a Game Theoretic Framework , 2016, AAAI.

[6]  Susan R. Fussell,et al.  Anthropomorphic Interactions with a Robot and Robot–like Agent , 2008 .

[7]  Reid G. Simmons,et al.  Affective social robots , 2010, Robotics Auton. Syst..

[8]  Finn Årup Nielsen,et al.  A New ANEW: Evaluation of a Word List for Sentiment Analysis in Microblogs , 2011, #MSM.

[9]  M. Erb,et al.  Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: quality, quantity, time course and gender differences , 2001, Psychiatry Research.

[10]  Erico Guizzo.  A robot in the family , 2015, IEEE Spectrum.

[11]  Atsuo Takanishi,et al.  Whole body emotion expressions for KOBIAN humanoid robot — preliminary experiments with different Emotional patterns — , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[12]  Rong Yang,et al.  Improving Resource Allocation Strategy against Human Adversaries in Security Games , 2011, IJCAI.

[13]  Fiorella de Rosis,et al.  Evaluating a realistic agent in an advice-giving task , 2005, Int. J. Hum. Comput. Stud..

[14]  Rong Yang,et al.  A robust approach to addressing human adversaries in security games , 2012, AAMAS.

[15]  Eun-Ja Hyun,et al.  Relationships between user experiences and children's perceptions of the education robot , 2010, HRI 2010.

[16]  Marilyn A. Walker,et al.  Perceived or Not Perceived: Film Character Models for Expressive NLG , 2011, ICIDS.

[17]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[18]  Susan R. Fussell,et al.  Comparing a computer agent with a humanoid robot , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Milind Tambe,et al.  A Robust Solution Concept for Human Bounded Rationality in Security Games , 2012 .

[20]  L. Steinberg.  A Social Neuroscience Perspective on Adolescent Risk-Taking. , 2008, Developmental review : DR.

[21]  Koen V. Hindriks,et al.  Robot mood is contagious: effects of robot body language in the imitation game , 2014, AAMAS.

[22]  M. Bradley,et al.  Measuring emotion: the Self-Assessment Manikin and the Semantic Differential. , 1994, Journal of behavior therapy and experimental psychiatry.

[23]  Marilyn A. Walker,et al.  An Annotated Corpus of Film Dialogue for Learning and Characterizing Character Style , 2012, LREC.

[24]  Nicolas Spatola,et al.  Not as bad as it seems: When the presence of a threatening humanoid robot improves human performance , 2018, Science Robotics.

[25]  Karsten Berns,et al.  Towards Social Robots: Designing an Emotion-Based Architecture , 2011, Int. J. Soc. Robotics.

[26]  Brett Stevens,et al.  Emotional body language displayed by artificial agents , 2012, TIIS.

[27]  Manuela M. Veloso,et al.  Towards a Robust Interactive and Learning Social Robot , 2018, AAMAS.

[28]  Horst-Michael Groß,et al.  TOOMAS: Interactive Shopping Guide robots in everyday use - final implementation and experiences from long-term field trials , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Elisabeth André,et al.  Creation and Evaluation of emotion expression with body movement, sound and eye color for humanoid robots , 2011, 2011 RO-MAN.

[30]  Matthias Scheutz,et al.  The utility of affect expression in natural language interactions in joint human-robot tasks , 2006, HRI '06.

[31]  Robert L. Mercer,et al.  Class-Based n-gram Models of Natural Language , 1992, CL.

[32]  Jonathan Gratch,et al.  The effect of expression of anger and happiness in computer agents on negotiations with humans , 2011, AAMAS.

[33]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[34]  Reid G. Simmons,et al.  Interactions with a moody robot , 2006, HRI '06.

[35]  Frank A. Drews,et al.  Passenger and Cell-Phone Conversations in Simulated Driving , 2004 .

[36]  Sarit Kraus,et al.  Bridging the Gap: Face-to-Face Negotiations with an Automated Mediator , 2011, IEEE Intelligent Systems.

[37]  Ana Paiva,et al.  Are emotional robots more fun to play with? , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[38]  Manuela M. Veloso,et al.  The Impact of Humanoid Affect Expression on Human Behavior in a Game-Theoretic Setting , 2018, ArXiv.

[39]  Mark A. Neerincx,et al.  Facial and vocal emotion expression of a personal computer assistant to engage, educate and motivate children , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[40]  Manabu Gouko,et al.  Fundamental Study of Robot Behavior that Encourages Human to Tidy up Table , 2015, HRI.

[41]  Sigal G. Barsade.  The Ripple Effect: Emotional Contagion and its Influence on Group Behavior , 2002 .

[42]  Bo An,et al.  Stackelberg Security Games: Looking Beyond a Decade of Success , 2018, IJCAI.

[43]  Mahmood Nooraie,et al.  Factors Influencing Strategic Decision-Making Processes , 2012 .

[44]  Milind Tambe,et al.  Effective solutions for real-world Stackelberg games: when agents must deal with human uncertainties , 2009, AAMAS 2009.

[45]  Hyeon-Jeong Suk.  Color and Emotion- a study on the affective judgment across media and in relation to visual stimuli , 2006 .

[46]  Jörgen Skågeby,et al.  “Well-Behaved Robots Rarely Make History”: Coactive Technologies and Partner Relations , 2018 .

[47]  Amos Azaria,et al.  Analyzing the Effectiveness of Adversary Modeling in Security Games , 2013, AAAI.