Costume vs. Wizard of Oz vs. Telepresence: How Social Presence Forms of Tele-operated Robots Influence Customer Behavior

In this study, we explore the effective form of social presence for a tele-operated robot to provide customer service. Particularly, we address the question on if and how a tele-operated robot displays the presence of an operator, and what effects it would have on people's perception and behavior toward it. We launched a tele-operated robot in a supermarket and had it deliver recipe flyers. We adjusted the robot's social presence by showing or not showing the photo of an operator's face (F) and using or not using voice conversion (V), leading to three forms of presence: Wizard of Oz (F: no, V: yes), costume (F: yes, V: yes), and telepresence (F: yes, V: no), which indicated the operator's presence from a low to a high level. We determined that the customers behaved significantly different when they faced the tele-operated robot in different forms. Our robot that exhibited a moderate presence of the operator (costume form) achieved the overall best performance. Based on these findings, we discuss both the strengths and weaknesses of the three forms of presence for a tele-operated robot and recommend the appropriate form for various applications.

[1]  H. Ishiguro,et al.  Exploring Possibilities of Social Robot’s Interactive Services in the Case of a Hotel Room , 2021, 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN).

[2]  Yuichiro Yoshikawa,et al.  Teleoperated Robot Sells Toothbrush in a Shopping Mall: A Field Study , 2021, CHI Extended Abstracts.

[3]  Carlos Martinho,et al.  Persuasion Strategies Using a Social Robot in an Interactive Storytelling Scenario , 2020, HAI.

[4]  Huayong Yang,et al.  Keep Healthcare Workers Safe: Application of Teleoperated Robot in Isolation Ward for COVID-19 Prevention and Control , 2020, Chinese Journal of Mechanical Engineering.

[5]  Yuichiro Yoshikawa,et al.  Teleoperated Robot Acting Autonomous for Better Customer Satisfaction , 2020, CHI Extended Abstracts.

[6]  Yoichi Yamazaki,et al.  Avatar Work: Telework for Disabled People Unable to Go Outside by Using Avatar Robots , 2020, HRI.

[7]  Takayuki Nagai,et al.  Estimating Children's Personalities Through Their Interaction Activities with a Tele-Operated Robot , 2020, J. Robotics Mechatronics.

[8]  Weiyan Shi,et al.  Effects of Persuasive Dialogues: Testing Bot Identities and Inquiry Strategies , 2020, CHI.

[9]  Carman Neustaedter,et al.  Shopping Over Distance through a Telepresence Robot , 2018, Proc. ACM Hum. Comput. Interact..

[10]  Jaap Ham,et al.  The influence of social cues in persuasive social robots on psychological reactance and compliance , 2018, Comput. Hum. Behav..

[11]  Takayuki Kanda,et al.  A Robot that Distributes Flyers to Pedestrians in a Shopping Mall , 2018, Int. J. Soc. Robotics.

[12]  Victor Kaptelinin,et al.  Probing the Design Space of a Telepresence Robot Gesture Arm with Low Fidelity Prototypes , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[13]  Tony Belpaeme,et al.  From characterising three years of HRI to methodology and reporting recommendations , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[14]  Weiguo Fan,et al.  Social Presence, Trust, and Social Commerce Purchase Intention: an Empirical Research , 2016, PACIS.

[15]  Takayuki Kanda,et al.  Escaping from Children’s Abuse of Social Robots , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Jaap Ham,et al.  Combining Robotic Persuasive Strategies: The Persuasive Power of a Storytelling Robot that Uses Gazing and Gestures , 2015, Int. J. Soc. Robotics.

[17]  Hyewon Lee,et al.  Will you follow the robot's advice?: the impact of robot types and task types on people's perception of a robot , 2014, HAI.

[18]  Sonya S. Kwak,et al.  The autonomy levels and the human intervention levels of robots: The impact of robot types in human-robot interaction , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[19]  Louis-Philippe Morency,et al.  It's only a computer: Virtual humans increase willingness to disclose , 2014, Comput. Hum. Behav..

[20]  Masahiko Morita,et al.  Telepresence Robot Helps Children in Communicating with Teachers who Speak a Different Language , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Sonya S. Kwak,et al.  Are You Embarrassed?: The Impact of Robot Types on Emotional Engagement with a Robot , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[22]  Sonya S. Kwak,et al.  What makes people empathize with an emotional robot?: The impact of agency and physical embodiment on human empathy for a robot , 2013, 2013 IEEE RO-MAN.

[23]  Hiroshi Ishiguro,et al.  Recommendation Effects of a Social Robot for Advertisement-Use Context in a Shopping Mall , 2013, International Journal of Social Robotics.

[24]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, J. Hum. Robot Interact..

[25]  Takayuki Kanda,et al.  A Communication Robot in a Shopping Mall , 2010, IEEE Transactions on Robotics.

[26]  Takayuki Kanda,et al.  A semi-autonomous communication robot — A field trial at a train station , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Naoki Mizukami,et al.  Japanese version of NASA Task Load Index , 1996 .

[28]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[29]  Kerstin Fischer,et al.  Gaze-Speech Coordination Influences the Persuasiveness of Human-Robot Dialog in the Wild , 2020, ICSR.