Bridging the gap between users' expectations and system evaluations

What users expect of a robot strongly influences their ratings of the interaction. If the robot satisfies the expectations, the users are usually pleased. If not, their experience of the interaction is negative. We as robot designers strive to design for positive interaction experiences. Therefore, users' expectations need to be taken into account. However, in this paper we argue that not all expectations are equally important. Based on a semantic differential questionnaire, we show a correlation between the perceived importance of users' expectations and the difficulty to satisfy them in interaction. The paper argues that this correlation allows to identify the most important improvements that should be made to robot systems but also to find attributes which the robot is quite good at already.

[1]  Takanori Komatsu How does Difference between Users’ Expectations and Perceptions about a Robotic Agent (Adaptation Gap) Affect Their Behaviors? , 2011 .

[2]  David Lee,et al.  Close encounters: spatial distances between people and a robot of mechanistic appearance , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[3]  P. Johnson-Laird,et al.  Mental Models: Towards a Cognitive Science of Language, Inference, and Consciousness , 1985 .

[4]  Britta Wrede,et al.  Domestic Applications for social robots - a user study on appearance and function , 2008 .

[5]  Roland Siegwart,et al.  What do people expect from robots? , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  C. Osgood,et al.  Semantic differential technique : a sourcebook , 1969 .

[7]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[8]  Manja Lohse,et al.  Investigating the influence of situations and expectations in user behavior - empirical analysis in human-robot interaction , 2010 .

[9]  Manja Lohse,et al.  The function of off-gaze in human-robot interaction , 2011, 2011 RO-MAN.

[10]  Henrik I. Christensen,et al.  Human-robot embodied interaction in hallway settings: a pilot user study , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[11]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .

[12]  Sara B. Kiesler,et al.  The advisor robot: tracing people's mental model from a robot's physical attributes , 2006, HRI '06.

[13]  Donald A. Norman,et al.  Affordance, conventions, and design , 1999, INTR.

[14]  Kai Oliver Arras,et al.  Do we want to share our lives and bodies with robots? A 2000 people survey , 2005 .

[15]  Sven Wachsmuth,et al.  ToBI - Team of Bielefeld: The Human-Robot Interaction System for RoboCup@Home 2009 , 2009 .