WoZ4U: An Open-Source Wizard-of-Oz Interface for Easy, Efficient and Robust HRI Experiments

Wizard-of-Oz experiments play a vital role in Human-Robot Interaction (HRI), as they allow for quick and simple hypothesis testing. Still, a publicly available general tool to conduct such experiments is currently not available in the research community, and researchers often develop and implement their own tools, customized for each individual experiment. Besides being inefficient in terms of programming efforts, this also makes it harder for non-technical researchers to conduct Wizard-of-Oz experiments. In this paper, we present a general and easy-to-use tool for the Pepper robot, one of the most commonly used robots in this context. While we provide the concrete interface for Pepper robots only, the system architecture is independent of the type of robot and can be adapted for other robots. A configuration file, which saves experiment-specific parameters, enables a quick setup for reproducible and repeatable Wizard-of-Oz experiments. A central server provides a graphical interface via a browser while handling the mapping of user input to actions on the robot. In our interface, keyboard shortcuts may be assigned to phrases, gestures, and composite behaviors to simplify and speed up control of the robot. The interface is lightweight and independent of the operating system. Our initial tests confirm that the system is functional, flexible, and easy to use. The interface, including source code, is made commonly available, and we hope that it will be useful for researchers with any background who want to conduct HRI experiments.

[1]  Seiji Yamada,et al.  Smoothing human-robot speech interactions by using a blinking-light as subtle expression , 2008, ICMI '08.

[2]  Tom Ziemke,et al.  What Is It Like to Be a Bot?: Toward More Immediate Wizard-of-Oz Control in Social Human-Robot Interaction , 2017, HAI.

[3]  Cynthia Breazeal,et al.  Crowdsourcing human-robot interaction , 2013, HRI 2013.

[4]  Päivi Heikkilä,et al.  A Social Service Robot in a Shopping Mall: Expectations of the Management, Retailers and Consumers , 2017, HRI.

[5]  Thomas Pellegrini,et al.  El-WOZ: a client-server wizard-of-oz open-source interface , 2014, LREC 2014.

[6]  Päivi Heikkilä,et al.  Hello Pepper, May I Tickle You?: Children's and Adults' Responses to an Entertainment Robot at a Shopping Mall , 2017, HRI.

[7]  Guy Hoffman OpenWoZ: A Runtime-Configurable Wizard-of-Oz Framework for Human-Robot Interaction , 2016, AAAI Spring Symposia.

[8]  A. W. Evans,et al.  Applying the Wizard-of-Oz Technique to Multimodal Human-Robot Dialogue , 2017, ArXiv.

[9]  Heinrich Hußmann,et al.  Mobia Modeler: easing the creation process of mobile applications for non-technical users , 2010, IUI '10.

[10]  Takayuki Kanda,et al.  Group attention control for communication robots with Wizard of OZ approach , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[11]  Sanja Dogramadzi,et al.  The Impact of Affective Verbal Expressions in Social Robots , 2020, HRI.

[12]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[13]  Kai-Florian Richter,et al.  Verbal explanations by collaborating robot teams , 2020, Paladyn J. Behav. Robotics.

[14]  Tom Ziemke,et al.  A Wizard of Oz Approach to Robotic Therapy for Older Adults With Depressive Symptoms , 2021, HRI.

[15]  William D. Smart,et al.  Polonius: A wizard of Oz interface for HRI experiments , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[16]  Blair MacIntyre,et al.  Wizard of Oz support throughout an iterative design process , 2005, IEEE Pervasive Computing.

[17]  Pablo V. A. Barros,et al.  Do I Have a Personality? Endowing Care Robots with Context-Dependent Personality Traits , 2020, International Journal of Social Robotics.

[18]  Niels Ole Bernsen,et al.  Designing interactive speech systems - from first ideas to user testing , 1998 .

[19]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[20]  Takayuki Kanda,et al.  Design patterns for sociality in human-robot interaction , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Gabriele Trovato,et al.  Wizard of Oz vs autonomous: Children's perception changes according to robot's operation condition , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[22]  Hans Ekkehard Plesser,et al.  Reproducibility vs. Replicability: A Brief History of a Confused Terminology , 2018, Front. Neuroinform..

[23]  Ginevra Castellano,et al.  Discovering social interaction strategies for robots from restricted-perception Wizard-of-Oz studies , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[24]  Dana Kulic,et al.  A Wizard-of-Oz study of curiosity in human-robot interaction , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[25]  Arne Jönsson,et al.  Wizard of Oz studies -- why and how , 1993, Knowl. Based Syst..

[26]  Nikolas Martelaro Wizard-of-Oz Interfaces as a Step Towards Autonomous HRI , 2016, AAAI Spring Symposia.

[27]  Anders Green,et al.  Investigating Spatial Relationships in Human-Robot Interaction , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Marcelo H. Ang,et al.  A Survey on Perception Methods for Human–Robot Interaction in Social Robots , 2013, International Journal of Social Robotics.

[29]  Manfred Tscheligi,et al.  The USUS Evaluation Framework for Human-Robot Interaction , 2009 .

[30]  Thomas Hellström,et al.  How Can a Robot Trigger Human Backchanneling? , 2020, 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN).

[31]  Yael Edan,et al.  Multimodal communication for guiding a person following robot , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[32]  Fumihide Tanaka,et al.  Pepper learns together with children: Development of an educational application , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[33]  Laurel D. Riek,et al.  Wizard of Oz studies in HRI , 2012, HRI 2012.

[34]  J. F. Kelley,et al.  An iterative design methodology for user-friendly natural language office information applications , 1984, TOIS.

[35]  David Lee,et al.  The influence of subjects' personality traits on personal spatial zones in a human-robot interaction experiment , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[36]  Thomas B. Sheridan,et al.  Human–Robot Interaction , 2016, Hum. Factors.

[37]  Bruno Maisonnier,et al.  Choregraphe: a graphical tool for humanoid robot programming , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[38]  Corrado Santoro,et al.  Experiences in Using the Pepper Robotic Platform for Museum Assistance Applications , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[39]  Stefan Wermter,et al.  Disambiguating Affective Stimulus Associations for Robot Perception and Dialogue , 2018, 2018 IEEE-RAS 18th International Conference on Humanoid Robots (Humanoids).

[40]  Chandima Dedduwa Pathiranage,et al.  A Wizard of Oz Study of Human Interest Towards Robot Initiated Human-Robot Interaction , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[41]  Tal Oron-Gilad,et al.  Closing the Feedback Loop: The Relationship Between Input and Output Modalities in Human-Robot Interactions , 2019, HFR.

[42]  Brian Scassellati,et al.  The effect of presence on human-robot interaction , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[43]  Tom Ziemke,et al.  Don't Judge a Book by its Cover: A Study of the Social Acceptance of NAO vs. Pepper , 2017, HAI.

[44]  Rodolphe Gelin,et al.  A Mass-Produced Sociable Humanoid Robot: Pepper: The First Machine of Its Kind , 2018, IEEE Robotics & Automation Magazine.