The Effect of Emotions and Social Behavior on Performance in a Collaborative Serious Game Between Humans and Autonomous Robots

The aim of this paper is to investigate performance in a collaborative human–robot interaction on a shared serious game task. Furthermore, the effect of elicited emotions and perceived social behavior categories on players’ performance will be investigated. The participants collaboratively played a turn-taking version of the Tower of Hanoi serious game, together with the human and robot collaborators. The elicited emotions were analyzed in regards to the arousal and valence variables, computed from the Geneva Emotion Wheel questionnaire. Moreover, the perceived social behavior categories were obtained from analyzing and grouping replies to the Interactive Experiences and Trust and Respect questionnaires. It was found that the results did not show a statistically significant difference in participants’ performance between the human or robot collaborators. Moreover, all of the collaborators elicited similar emotions, where the human collaborator was perceived as more credible and socially present than the robot one. It is suggested that using robot collaborators might be as efficient as using human ones, in the context of serious game collaborative tasks.

[1]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[2]  J. Russell.  A circumplex model of affect. , 1980 .

[3]  W Karwowski,et al.  Worker selection of safe speed and idle condition in simulated monitoring of two industrial robots. , 1991, Ergonomics.

[4]  R. Bennett.  Introduction: Health and Safety , 1991 .

[5]  H. Sypher,et al.  Communication Research Measures: A Sourcebook , 1994 .

[6]  G. Loewenstein.  Out of control: Visceral influences on behavior , 1996 .

[7]  T. Koda,et al.  Agents with faces: the effect of personification , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[8]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[9]  Jonathan Schaeffer,et al.  One jump ahead - challenging human supremacy in checkers , 1997, J. Int. Comput. Games Assoc..

[10]  J. Gross.  The Emerging Field of Emotion Regulation: An Integrative Review , 1998 .

[11]  Hans P. Moravec.  Robot: Mere Machine to Transcendent Mind , 1998 .

[12]  Judee K. Burgoon,et al.  The impact of anthropomorphic interfaces on influence understanding, and credibility , 1999, Proceedings of the 32nd Annual Hawaii International Conference on Systems Sciences. 1999. HICSS-32. Abstracts and CD-ROM of Full Papers.

[13]  Wolfram Burgard,et al.  MINERVA: a second-generation museum tour-guide robot , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[14]  J. Burgoon,et al.  Interactivity in human–computer interaction: a study of credibility, understanding, and influence , 2000 .

[15]  Patrice D. Tremoulet,et al.  Perceptual causality and animacy , 2000, Trends in Cognitive Sciences.

[16]  G. Loewenstein.  Emotions in Economic Theory and Economic Behavior , 2000 .

[17]  Matthew Lombard,et al.  MEASURING PRESENCE: A LITERATURE-BASED APPROACH TO THE DEVELOPMENT OF A STANDARDIZED PAPER-AND-PENCIL INSTRUMENT , 2000 .

[18]  John Travis Butler,et al.  Psychological Effects of Behavior Patterns of a Mobile Personal Robot , 2001, Auton. Robots.

[19]  Jennifer Healey,et al.  Toward Machine Emotional Intelligence: Analysis of Affective Physiological State , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Cynthia Breazeal,et al.  Designing Sociable Machines , 2002 .

[21]  Cynthia Breazeal,et al.  Designing sociable robots , 2002 .

[22]  Sara B. Kiesler,et al.  Cooperation with a robotic assistant , 2002, CHI Extended Abstracts.

[23]  Norah E. Dunbar,et al.  Testing the Interactivity Principle: Effects of Mediation, Propinquity, and Verbal and Nonverbal Modalities in Interpersonal Interaction , 2002 .

[24]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[25]  Futoshi Naya,et al.  Human-Robot Dynamic Social Interaction , 2003 .

[26]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[27]  Cory D. Kidd,et al.  Sociable robots : the role of presence and task in human-robot interaction , 2003 .

[28]  David S. Touretzky,et al.  Tekkotsu: Cognitive Robotics on the Sony AIBO , 2004, ICCM.

[29]  Guy Hoffman,et al.  Robot's play: interactive games with sociable machines , 2004, ACE '04.

[30]  K. M. Lee,et al.  Effects of Physical Embodiment on Social Presence of Social Robots , 2004 .

[31]  Cynthia Breazeal,et al.  Effect of a robot on user perceptions , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[32]  D. Norman.  Emotional design : why we love (or hate) everyday things , 2004 .

[33]  Candace L. Sidner,et al.  Where to look: a study of human-robot engagement , 2004, IUI '04.

[34]  Pamela J. Hinds,et al.  Whose Job Is It Anyway? A Study of Human-Robot Interaction in a Collaborative Task , 2004, Hum. Comput. Interact..

[35]  K. Scherer.  What are emotions? And how can they be measured? , 2005 .

[36]  Kerstin Dautenhahn,et al.  Methodological issues using a comfort level device in human-robot interactions , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[37]  Rachid Alami,et al.  Navigation in the presence of humans , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[38]  David Lee,et al.  The influence of subjects' personality traits on personal spatial zones in a human-robot interaction experiment , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[39]  Fredrik Rehnmark,et al.  Robonaut: the 'short list' of technology hurdles , 2005, Computer.

[40]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[41]  Antonio Damasio,et al.  The somatic marker hypothesis: A neural theory of economic decision , 2005, Games Econ. Behav..

[42]  Kerstin Dautenhahn,et al.  Practical and methodological challenges in designing and conducting human-robot interaction studies , 2005 .

[43]  Kerstin Dautenhahn,et al.  'Doing the right thing wrong' - Personality and tolerance to uncomfortable robot approaches , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[44]  Ehud Sharlin,et al.  Exploring Human-Robot Interaction Through Telepresence Board Games , 2006, ICAT.

[45]  Christoph Bartneck,et al.  “Daisy, daisy, give me your answer do!” switching off a robot , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[46]  Tarja Susi,et al.  Serious Games : An Overview , 2007 .

[47]  E. Soane,et al.  Thinking, feeling and deciding: The influence of emotions on the decision making and performance of traders , 2011 .

[48]  Jenova Chen,et al.  Flow in games (and everything else) , 2007, CACM.

[49]  Ehud Sharlin,et al.  Playing Games with Robots - A Method for Evaluating Human-Robot Interaction , 2007 .

[50]  Kerstin Dautenhahn,et al.  Methodology & Themes of Human-Robot Interaction: A Growing Research Field , 2007 .

[51]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[52]  Susan R. Fussell,et al.  Comparing a computer agent with a humanoid robot , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  K. Lambert.  Handbook of Emotion Regulation , 2007 .

[54]  Takayuki Kanda.  Field trial approach for communication robots , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[55]  Vanessa Evers,et al.  The influence of social presence on acceptance of a companion robot by older people , 2008 .

[56]  Elizabeth A. Croft,et al.  Enhancing collaborative human-robot interaction through physiological-signal based communication , 2010 .

[57]  Nadia Hocine,et al.  Difficulty and Scenario Adaptation: An Approach to Customize Therapeutic Games , 2011 .

[58]  Desney S. Tan,et al.  Proceedings of the 2008 Conference on Human Factors in Computing Systems, CHI 2008, 2008, Florence, Italy, April 5-10, 2008 , 2005, CHI 2008.

[59]  Christof Weinhardt,et al.  Measuring Emotions in Electronic Markets , 2011, ICIS.

[60]  Ana Paiva,et al.  Automatic analysis of affective postures and body motion to detect engagement with a game companion , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[61]  Fumiya Iida,et al.  The challenges ahead for bio-inspired 'soft' robotics , 2012, CACM.

[62]  Ana Paiva,et al.  Detecting Engagement in HRI: An Exploration of Social and Task-Based Context , 2012, 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Confernece on Social Computing.

[63]  Ana Paiva,et al.  Socially Present Board Game Opponents , 2012, Advances in Computer Entertainment.

[64]  Michael D. Smith,et al.  Strategies for tomorrow's 'winners-take-some' digital goods markets , 2013, CACM.

[65]  Travis J. Wiltshire,et al.  Toward understanding social cues and signals in human–robot interaction: effects of robot gaze and proxemic behavior , 2013, Front. Psychol..

[66]  H. Bülthoff,et al.  View dependencies in the visual recognition of social interactions , 2013, Front. Psychol..

[67]  Adriana Tapus,et al.  Coping with Stress Using Social Robots as Emotion-Oriented Tool: Potential Factors Discovered from Stress Game Experiment , 2013, ICSR.

[68]  Kerstin Dautenhahn,et al.  A Pilot Study with a Novel Setup for Collaborative Play of the Humanoid Robot KASPAR with Children with Autism , 2014, Int. J. Soc. Robotics.

[69]  R. Pfeifer,et al.  Cognition from the bottom up: on biological inspiration, body morphology, and soft materials , 2014, Trends in Cognitive Sciences.

[70]  Yiannis Demiris,et al.  Adaptive human-robot interaction in sensorimotor task instruction: From human to robot dance tutors , 2014, Robotics Auton. Syst..

[71]  Florian Röhrbein,et al.  Gearing up and accelerating cross-fertilization between academic and industrial robotics research in Europe: , 2014 .

[72]  Johan Svensson,et al.  Psychophysiological Interaction and Empathic Cognition for Human-Robot Cooperative Work (PsyIntEC) , 2014, Technology Transfer Experiments from the ECHORD Project.

[73]  Shuichi Nishio,et al.  Affectionate Interaction with a Small Humanoid Robot Capable of Recognizing Social Touch Behavior , 2014, ACM Trans. Interact. Intell. Syst..

[74]  P. Perry.  Introduction to health and safety , 2016 .

[75]  W. IJsselsteijn,et al.  Virtually There? A Vision on Presence Research , 2018 .

[76]  D. Hoang.  FLOW: The Psychology of Optimal Experience , 2018 .

[77]  Joseph P. Mazer,et al.  Communication Research Measures III , 2019 .

[78]  H. Sangani,et al.  DO ANDROIDS DREAM OF ELECTRIC SHEEP? , 2020, Faculty Brat.

[79]  R. Likert.  “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.