Remote You, Haru and Me: Exploring Social Interaction in Telepresence Gaming With a Robotic Agent

Novel forms of two-player telegame interaction might extend and enhance social connection between physically separated persons. We examine the potential of a Rock-Paper-Scissors game conveyed via an embodied telepresence agent. We compare a game interaction with an autonomous robot and a game interaction with a teleoperated version of the same robot. Both systems are equipped with a perception module that processes and recognizes the hand movement of the human players colocated with the robot. In the classic interaction, the robot acts as the opponent player. In the telegame setting, the robot represents and mirrors the actions of the remote human player as the opponent. We integrate the systems on the tabletop robot platform Haru and evaluate user impressions with respect to game experience and robot sociality. Results show that the telegame is perceived more positively, indicating its potential for physically distant, but socially enhanced interaction in the future.

[1]  G. Pietrabissa,et al.  Psychological Consequences of Social Isolation During COVID-19 Outbreak , 2020, Frontiers in Psychology.

[2]  Kim Usher,et al.  Life in the pandemic: Social isolation and mental health. , 2020, Journal of clinical nursing.

[3]  Ali Meghdari,et al.  Playing Rock-Paper-Scissors with RASA: A Case Study on Intention Prediction in Human-Robot Interactive Games , 2019, ICSR.

[4]  Cynthia Breazeal,et al.  Affective Personalization of a Social Robot Tutor for Children's Second Language Skills , 2016, AAAI.

[5]  Heike Brock,et al.  Developing a Lightweight Rock-Paper-Scissors Framework for Human-Robot Collaborative Gaming , 2020, IEEE Access.

[6]  Joris B. Janssen,et al.  Motivating Children to Learn Arithmetic with an Adaptive Robot Game , 2011, ICSR.

[7]  Aaron Steinfeld,et al.  A deceptive robot referee in a multiplayer gaming environment , 2011, 2011 International Conference on Collaboration Technologies and Systems (CTS).

[8]  C. Breazeal,et al.  Escape!Bot: Child-Robot Interaction to Promote Creative Expression During Gameplay , 2020, CHI PLAY.

[9]  Keisuke Nakamura,et al.  Haru: Hardware Design of an Experimental Tabletop Robot Assistant , 2018, HRI.

[10]  Randy Gomez,et al.  Social Robots for Socio-Physical Distancing , 2020, ICSR.

[11]  Filipa Correia,et al.  A Social Robot as a Card Game Player , 2021, AIIDE.

[12]  Keisuke Nakamura,et al.  A Holistic Approach in Designing Tabletop Robot’s Expressivity , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[13]  D. Kort,et al.  D3.3 : Game Experience Questionnaire:development of a self-report measure to assess the psychological impact of digital games , 2007 .

[14]  Alma Leora Culén,et al.  Mediating Relatedness for Adolescents with ME: Reducing Isolation through Minimal Interactions with a Robot Avatar , 2019, Conference on Designing Interactive Systems.

[15]  Brian Scassellati,et al.  Improving social skills in children with ASD using a long-term, in-home social robot , 2018, Science Robotics.

[16]  Selma Sabanovic,et al.  More than just friends: in-home use and design recommendations for sensing socially assistive robots (SARs) by older adults with depression , 2019, Paladyn J. Behav. Robotics.

[17]  Satu Pekkarinen,et al.  Can robots tackle late-life loneliness? Scanning of future opportunities and challenges in assisted living facilities , 2020, Futures.

[18]  Steven J. Stroessner,et al.  The Robotic Social Attributes Scale (RoSAS): Development and Validation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[19]  Brian Scassellati,et al.  No fair!! An interaction with a cheating robot , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[20]  R. Riener,et al.  Increasing motivation in robot-aided arm rehabilitation with competitive and cooperative gameplay , 2014, Journal of NeuroEngineering and Rehabilitation.

[21]  Hyemi Kim,et al.  Fribo: A Social Networking Robot for Increasing Social Connectedness through Sharing Daily Home Activities from Living Noise Data , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).