Capturing Expertise: Developing Interaction Content for a Robot Through Teleoperation by Domain Experts

The development of humanlike service robots which interact socially raises a new question: how can we create good interaction content for such robots? Domain experts specializing in the target service have the knowledge for making such content. Yet, while they can easily engage in good face-to-face interactions, we found it difficult for them to prepare conversational content for a robot in written form. Instead, we propose involving experts as teleoperators in a short-cycle iterative development process in which the expert develops content, teleoperates a robot using that content, and then revises the content based on that interaction. We propose a software system and design guidelines to enable such an iterative design process. To validate these solutions, we conducted a comparison experiment in the field, with a teleoperated robot acting as a guide at a tourist information center in Nara, Japan. The results showed that our system and guidelines enabled domain experts with no robotics background to create better interaction content and conduct better interactions than domain experts without our system.

[1]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[2]  M. Polanyi Personal Knowledge: Towards a post-critical philosophy , 1959 .

[3]  W. Bean Personal Knowledge: Towards a Post-Critical Philosophy , 1961 .

[4]  S. Feldstein,et al.  Rhythms of dialogue , 1970 .

[5]  E. Schegloff,et al.  A simplest systematics for the organization of turn-taking for conversation , 1974 .

[6]  Jeffrey M. Bradshaw,et al.  Expertise Transfer and Complex Problems: Using AQUINAS as a Knowledge-Acquisition Workbench for Knowledge-Based Systems , 1987, Int. J. Man Mach. Stud..

[7]  Arne Jönsson,et al.  Wizard of Oz studies -- why and how , 1993, Knowl. Based Syst..

[8]  Arne Jönsson,et al.  Wizard of Oz studies: why and how , 1993, IUI '93.

[9]  Michael F. McTear,et al.  Modelling spoken dialogues with state transition diagrams: experiences with the CSLU toolkit , 1998, ICSLP.

[10]  M. Eraut Non-formal learning and tacit knowledge in professional work. , 2000, The British journal of educational psychology.

[11]  Nigel G. Ward,et al.  Prosodic features which cue back-channel responses in English and Japanese , 2000 .

[12]  Peter Wallis,et al.  Dialogue Modelling for a Conversational Agent , 2001, Australian Joint Conference on Artificial Intelligence.

[13]  Michael F. McTear,et al.  Book Review: Spoken Dialogue Technology: Toward the Conversational User Interface, by Michael F. McTear , 2002, CL.

[14]  Joelle Pineau,et al.  Towards robotic assistants in nursing homes: Challenges and results , 2003, Robotics Auton. Syst..

[15]  Tetsuo Ono,et al.  Development and evaluation of interactive humanoid robots , 2004, Proceedings of the IEEE.

[16]  Keiichi Tokuda,et al.  XIMERA: a new TTS from ATR based on corpus-based technologies , 2004, SSW.

[17]  David G. Novick,et al.  Some Usability Issues and Research Priorities in Spoken Dialog Applications , 2005 .

[18]  Stephanie Rosenthal,et al.  Designing robots for long-term social interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  J. Petelin,et al.  Deployment and early experience with remote-presence patient care in a community hospital , 2005, Surgical Endoscopy.

[20]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[21]  Mitsuru Ishizuka,et al.  A markup language for describing interactive humanoid robot presentations , 2007, IUI '07.

[22]  Nigel G. Ward,et al.  A combined method for discovering short-term affect-based response rules for spoken tutorial dialog , 2007, SLaTE.

[23]  Alexander I. Rudnicky,et al.  Olympus: an open-source framework for conversational spoken language interface research , 2007, HLT-NAACL 2007.

[24]  Brigitte Krenn,et al.  Functional Mark-up for Behaviour Planning : Theory and Practice , 2008 .

[25]  Horst-Michael Groß,et al.  ShopBot: Progress in developing an interactive mobile shopping assistant for everyday use , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[26]  Takayuki Kanda,et al.  Design patterns for sociality in human-robot interaction , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Takayuki Kanda,et al.  How quickly should communication robots respond? , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Takayuki Kanda,et al.  An affective guide robot in a shopping mall , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Takayuki Kanda,et al.  Field trial of networked social robots in a shopping mall , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Andrea Lockerd Thomaz,et al.  Turn Taking for Human-Robot Interaction , 2010, AAAI Fall Symposium: Dialog with Robots.

[31]  Manfred Tscheligi,et al.  Robots asking for directions — The willingness of passers-by to support robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[32]  Peng Zang,et al.  Batch versus interactive learning by demonstration , 2010, 2010 IEEE 9th International Conference on Development and Learning.

[33]  Takayuki Kanda,et al.  A Communication Robot in a Shopping Mall , 2010, IEEE Transactions on Robotics.

[34]  Cynthia Breazeal,et al.  Crowdsourcing HRI through Online Multiplayer Games , 2010, AAAI Fall Symposium: Dialog with Robots.

[35]  Katherine M. Tsui,et al.  Exploring use cases for telepresence robots , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[36]  María Malfaz,et al.  Learning the Selection of Actions for an Autonomous Social Robot by Reinforcement Learning Based on Motivations , 2011, Int. J. Soc. Robotics.

[37]  Charles R. Crowell,et al.  DOMER: A Wizard of Oz interface for using interactive robots to scaffold social skills for children with Autism Spectrum Disorders , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[38]  B. MacDonald,et al.  Multidisciplinary Design Approach for Implementation of Interactive Services , 2011, Int. J. Soc. Robotics.

[39]  Takayuki Kanda,et al.  An Interaction Design Framework for Social Robots , 2011, Robotics: Science and Systems.

[40]  Kuanhao Zheng,et al.  How many social robots can one operator control? , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[41]  Leila Takayama,et al.  Assisted driving of a mobile remote presence system: System design and controlled user evaluation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[42]  Takayuki Kanda,et al.  Temporal Awareness in Teleoperation of Conversational Robots , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[43]  Takayuki Kanda,et al.  Teleoperation of Multiple Social Robots , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[44]  Nicholas Roy,et al.  An Interaction Design Framework for Social Robots , 2012 .

[45]  Munsang Kim,et al.  Easy Interface and Control of Tele-education Robots , 2013, Int. J. Soc. Robotics.

[46]  Takayuki Kanda,et al.  Guidelines for Contextual Motion Design of a Humanoid Robot , 2013, Int. J. Soc. Robotics.

[47]  Sven Wachsmuth,et al.  A Modeling Framework for User-Driven Iterative Design of Autonomous Systems , 2013, International Journal of Social Robotics.

[48]  D. Sommer Personal Knowledge Towards A Post Critical Philosophy , 2016 .

[49]  M. Murdocca,et al.  $$L^p({\mathbb{R }}^n)$$Lp(Rn)-continuity of translation invariant anisotropic pseudodifferential operators: a necessary condition , 2012, 1210.0694.