User experience evaluation with a Wizard of Oz approach: Technical and methodological considerations

User experience evaluation in human-robot interaction is most often an expensive and difficult task. To allow the evaluation of various factors and aspects of user experience, a fully functional (humanoid) robot is recommended. This work presents technical and methodological considerations on the applicability of the Wizard of Oz (WOz) approach to enable user experience evaluation in the field of Human-Robot Interaction. We briefly describe the technical aspects of the setup, the applicability of the method, and a first case study using this methodological approach to gain an early understanding of the user experience factors that are important for the development of a human-humanoid interaction scenario.

[1]  Jun Hu,et al.  Rapid prototyping for interactive robots , 2004 .

[2]  Tetsuo Ono,et al.  A humanoid robot that pretends to listen to route guidance from a human , 2007, Auton. Robots.

[3]  Mark Billinghurst,et al.  A Wizard of Oz study for an AR multimodal interface , 2008, ICMI '08.

[4]  Manfred Tscheligi,et al.  The USUS Evaluation Framework for Human-Robot Interaction , 2009 .

[5]  Joëlle Coutaz,et al.  Applying the Wizard of Oz Technique to the Study of Multimodal Systems , 1993, EWHCI.

[6]  Sara Ljungblad,et al.  Where Third Wave HCI Meets HRI: Report from a workshop on user-centred design of robots , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[8]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[9]  Kerstin Dautenhahn,et al.  Methodology & Themes of Human-Robot Interaction: A Growing Research Field , 2007 .

[10]  A. Green,et al.  Applying the Wizard-of-Oz framework to cooperative service discovery and configuration , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[11]  Jane Fulton Suri,et al.  Experience prototyping , 2000, DIS '00.

[12]  Diego Gutierrez,et al.  Exploiting perception in high-fidelity virtual environments (Additional presentations from the 24th course are available on the citation page) , 2006, SIGGRAPH Courses.

[13]  Marc Hassenzahl,et al.  MARC HASSENZAHL CHAPTER 3 The Thing and I: Understanding the Relationship Between User and Product , 2003 .