Modeling Human-Robot Interaction Based on Generic Interaction Patterns

While human-robot interaction is typically limited to restrictive command-control style, traditional dialog modeling approaches are not directly applicable to robotics due to the lack of real-world integration. We present an approach that combines insights from dialog modeling with software-engineering demands that arise in robotics system research to provide a generalizable framework that can easily be applied to new scenarios. This goal is achieved by defining interaction patterns that combine abstract task states (such as task accepted or failed) with robot dialog acts (such as assertion or apology). An evaluation of the usability for robotic experts and novices showed that both groups were able to program 3 out of 5 dialog fragments in one hour while showing a steep learning curve. We argue that the proposed approach allows for less restricted and more informative human-robot interactions.

[1]  Jean-Marc Odobez,et al.  Engagement-based Multi-party Dialog with a Humanoid Robot , 2011, SIGDIAL Conference.

[2]  Thomas Röfer,et al.  SimRobot - A General Physical Robot Simulator and Its Application in RoboCup , 2005, RoboCup.

[3]  Kerstin Dautenhahn,et al.  A quantitative technique for analysing robot-human interactions , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Alexander I. Rudnicky,et al.  N-best speech hypotheses reordering using linear regression , 2001, INTERSPEECH.

[5]  Ingo Lütkebohle,et al.  The bielefeld anthropomorphic robot head “Flobi” , 2010, 2010 IEEE International Conference on Robotics and Automation.

[6]  Julia Hirschberg,et al.  Predicting Automatic Speech Recognition Performance Using Prosodic Cues , 2000, ANLP.

[7]  Britta Wrede,et al.  Playing a different imitation game: Interaction with an Empathic Android Robot , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[8]  Jannik Fritsch,et al.  "BIRON, let me show you something": evaluating the interaction with a robot companion , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[9]  Marilyn A. Walker,et al.  Evaluating spoken dialogue agents with PARADISE: Two case studies , 1998, Comput. Speech Lang..

[10]  Marilyn A. Walker,et al.  THE UTILITY OF ELAPSED TIME AS A USABILITY METRIC FOR SPOKEN DIALOGUE SYSTEMS , 2007 .

[11]  Oliver Lemon,et al.  Managing Dialogue Interaction: A Multi-Layered Approach , 2003, SIGDIAL Workshop.

[12]  Satoshi Nakamura,et al.  Active Learning for Generating Motion and Utterances in Object Manipulation Dialogue Tasks , 2010, AAAI Fall Symposium: Dialog with Robots.

[13]  Ingo Lütkebohle,et al.  The curious robot - Structuring interactive robot learning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[14]  Lynette Hirschman,et al.  The cost of errors in a spoken language system , 1993, EUROSPEECH.

[15]  Helge J. Ritter,et al.  Platform portable anthropomorphic grasping with the bielefeld 20-DOF shadow and 9-DOF TUM hand , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Arne Jönsson,et al.  Dialogue and Domain Knowledge Management in Dialogue Systems , 2000, SIGDIAL Workshop.

[17]  Maxine Eskénazi,et al.  A Finite-State Turn-Taking Model for Spoken Dialog Systems , 2009, NAACL.

[18]  Sebastian Wrede,et al.  A middleware for collaborative research in experimental robotics , 2011, 2011 IEEE/SICE International Symposium on System Integration (SII).

[19]  Sebastian Möller,et al.  Predicting the quality and usability of spoken dialogue services , 2008, Speech Commun..

[20]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[21]  Morena Danieli,et al.  Metrics for Evaluating Dialogue Strategies in a Spoken Language System , 1996, ArXiv.

[22]  Britta Wrede,et al.  Pamini: A framework for assembling mixed-initiative human-robot interaction from generic interaction patterns , 2010, SIGDIAL Conference.

[23]  Gregory S. Chirikjian,et al.  Modular Robot Motion Planning Using Similarity Metrics , 2001, Auton. Robots.

[24]  Patrizia Scandurra,et al.  Component-based robotic engineering (Part I) [Tutorial] , 2009, IEEE Robotics & Automation Magazine.

[25]  Jannik Fritsch,et al.  Human-style interaction with a robot for cooperative learning of scene objects , 2005, ICMI '05.

[26]  Charles Rich,et al.  A plug-in architecture for generating collaborative agent responses , 2002, AAMAS '02.

[27]  Candace L. Sidner,et al.  Collaborative Discourse, Engagement and Always-On Relational Agents , 2010, AAAI Fall Symposium: Dialog with Robots.

[28]  Jeffrey M. Bradshaw,et al.  What Is a Conversation Policy? , 2000, Issues in Agent Communication.

[29]  Alexander I. Rudnicky,et al.  The RavenClaw dialog management framework: Architecture and systems , 2009, Comput. Speech Lang..

[30]  James A. Moore,et al.  Dialogue-Games: Metacommunication Structures for Natural Language Interaction , 1977, Cogn. Sci..

[31]  J. Oberlander,et al.  Using Facial Feedback to Enhance Turn-Taking in a Multimodal Dialogue System , 2005 .

[32]  Ingo Lütkebohle,et al.  Where is this? - gesture based multimodal interaction with an anthropomorphic robot , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[33]  Sven Wachsmuth,et al.  What can I do for you? Appearance and Application of Robots , 2007 .

[34]  Staffan Larsson,et al.  Information state and dialogue management in the TRINDI dialogue move engine toolkit , 2000, Natural Language Engineering.

[35]  Heiko Wersing,et al.  A biologically motivated visual memory architecture for online learning of objects , 2008, Neural Networks.

[36]  Kerstin Dautenhahn,et al.  Robotic etiquette: Results from user studies involving a fetch and carry task , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[37]  Elin Anna Topp,et al.  Human-Robot Interaction and Mapping with a Service Robot: Human Augmented Mapping , 2008 .

[38]  Roberto Pieraccini,et al.  Where do we go from here? Research and Commercial Spoken Dialog Systems , 2005, SIGDIAL.

[39]  Takayuki Nagai,et al.  Robots that Learn to Communicate: A Developmental Approach to Personally and Physically Situated Human-Robot Conversations , 2010, AAAI Fall Symposium: Dialog with Robots.

[40]  Sven Wachsmuth,et al.  “The hand is not a banana”. On Developing a Robot’s Grounding Facilities , 2012 .

[41]  Pierre Lison,et al.  Continual processing of situated dialogue in human-robot collaborative activities , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[42]  Oliver Lemon Context-sensitive speech recognition in ISU dialogue systems: results for the grammar switching approach , 2004 .

[43]  T. Kanda,et al.  Psychology in human-robot communication: an attempt through investigation of negative attitudes and anxiety toward robots , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[44]  Volker Graefe,et al.  Dependable multimodal communication and interaction with robotic assistants , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[45]  Marilyn A. Walker,et al.  PARADISE: A Framework for Evaluating Spoken Dialogue Agents , 1997, ACL.

[46]  Cynthia Breazeal,et al.  Crowdsourcing HRI through Online Multiplayer Games , 2010, AAAI Fall Symposium: Dialog with Robots.

[47]  Cynthia Breazeal,et al.  Emotive qualities in lip-synchronized robot speech , 2003, Adv. Robotics.

[48]  Robert Ross,et al.  Putting Things in Context: Situated Language Understanding for Human-Robot Dialog(ue) , 2010, AAAI Fall Symposium: Dialog with Robots.

[49]  Alexander I. Rudnicky,et al.  LARRI: A Language-Based Maintenance and Repair Assistant , 2005 .

[50]  Gerhard Sagerer,et al.  Theory of Mind (ToM) on robots: A functional neuroimaging study , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[51]  Johannes Pittermann Spoken Dialogue Technology: Toward the Conversational User Interface by Michael F. McTear , 2005, Comput. Linguistics.

[52]  Matthias Scheutz,et al.  What to do and how to do it: Translating natural language directives into temporal and dynamic logic representation for goal management and action execution , 2009, 2009 IEEE International Conference on Robotics and Automation.

[53]  Derek G. Bridge,et al.  Towards Conversational Recommender Systems: A Dialogue Grammar Approach , 2002, ECCBR Workshops.

[54]  Timothy W. Finin,et al.  KQML as an agent communication language , 1994, CIKM '94.

[55]  Matthias Denecke Rapid Prototyping for Spoken Dialogue Systems , 2002, COLING.

[56]  Takayuki Kanda,et al.  How to approach humans?-strategies for social robots to initiate interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[57]  Ulrich Endriss,et al.  Abstract models for dialogue protocols , 2007, J. Log. Lang. Inf..

[58]  Michael F. McTear,et al.  Object-oriented modelling of spoken language dialogue systems , 2000, Nat. Lang. Eng..

[59]  Britta Wrede,et al.  The Curious Robot as a Case-Study for Comparing Dialog Systems , 2011, AI Mag..

[60]  Alexander I. Rudnicky,et al.  Olympus: an open-source framework for conversational spoken language interface research , 2007, HLT-NAACL 2007.

[61]  Ingo Lütkebohle,et al.  Mixed Initiative in Interactive Robotic Learning , 2009 .

[62]  Heiko Wersing,et al.  Feedback interpretation based on facial expressions in human-robot interaction , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[63]  George H. Mealy,et al.  A method for synthesizing sequential circuits , 1955 .

[64]  David R Traum,et al.  Towards a Computational Theory of Grounding in Natural Language Conversation , 1991 .

[65]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[66]  Mark S. Fox,et al.  COOL: A Language for Describing Coordination in Multi Agent Systems , 1995, ICMAS.

[67]  Marilyn A. Walker,et al.  Towards developing general models of usability with PARADISE , 2000, Natural Language Engineering.

[68]  Karl F. MacDorman,et al.  Human emotion and the uncanny valley: A GLM, MDS, and Isomap analysis of robot video ratings , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[69]  James F. Allen,et al.  TRAINS-95: Towards a Mixed-Initiative Planning Assistant , 1996, AIPS.

[70]  Constantine D. Spyropoulos,et al.  HUMAN-ROBOT INTERACTION BASED ON SPOKEN NATURAL LANGUAGE DIALOGUE , 2001 .

[71]  Gabriel Skantze,et al.  A General, Abstract Model of Incremental Dialogue Processing , 2009, EACL.

[72]  Gerhard Sagerer,et al.  Robust Speech Understanding for Multi-Modal Human-Robot Communication , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[73]  Ingo Lütkebohle,et al.  Talking with robots about objects: A system-level evaluation in HRI , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[74]  Olga Gerassimenko,et al.  Towards computer-human interaction in natural language , 2009, Int. J. Comput. Appl. Technol..

[75]  P. D. O'Brien,et al.  FIPA — Towards a Standard for Software Agents , 1998 .

[76]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[77]  Alexander I. Rudnicky,et al.  Dynamically Formed Human-Robot Teams Performing Coordinated Tasks , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[78]  Reid G. Simmons,et al.  Affective social robots , 2010, Robotics Auton. Syst..

[79]  Sebastian Wrede,et al.  An Integration Framework for Developing Interactive Robots , 2005, PPSDR@ICRA.

[80]  Norbert Reithinger,et al.  An integration framework for a mobile multimodal dialogue system accessing the semantic web , 2005, INTERSPEECH.

[81]  Chrystopher L. Nehaniv,et al.  Action, State and Effect Metrics for Robot Imitation , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[82]  Don Roberts,et al.  Evolving Frameworks A Pattern Language for Developing Object-Oriented Frameworks , 2004 .

[83]  Joris Hulstijn,et al.  Dialogue Games are Recipes for Joint Action , 2000 .

[84]  Candace L. Sidner,et al.  COLLAGEN: Applying Collaborative Discourse Theory to Human-Computer Interaction , 2001, AI Mag..

[85]  Lewis M. Norton,et al.  Beyond Class A: A Proposal for Automatic Evaluation of Discourse , 1990, HLT.

[86]  Gernot A. Fink Developing HMM-Based Recognizers with ESMERALDA , 1999, TSD.

[87]  H. Van Dyke Parunak,et al.  Visualizing Agent Conversations: Using Enhanced Dooley Graphs for Agent Design and Analysis , 1996 .

[88]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[89]  Sven Wachsmuth,et al.  ToBI - Team of Bielefeld: The Human-Robot Interaction System for RoboCup@Home 2009 , 2009 .

[90]  Ingo Lütkebohle,et al.  The Curious Robot learns grasping in multi-modal interaction , 2010 .

[91]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[92]  Csr Young,et al.  How to Do Things With Words , 2009 .

[93]  Ronald A. Cole,et al.  Building 10,000 spoken dialogue systems , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[94]  Helge J. Ritter,et al.  Bio-inspired motion strategies for a bimanual manipulation task , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[95]  Elizabeth Shriberg,et al.  Human-Machine Problem Solving Using Spoken Language Systems (SLS): Factors Affecting Performance and User Satisfaction , 1992, HLT.

[96]  Tatsuya Nomura,et al.  Prediction of Human Behavior in Human--Robot Interaction Using Psychological Scales for Anxiety and Negative Attitudes Toward Robots , 2008, IEEE Transactions on Robotics.

[97]  Cynthia Breazeal,et al.  Improved human-robot team performance using Chaski, A human-inspired plan execution system , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[98]  Arturo Espinosa-Romero,et al.  Talking to Godot: dialogue with a mobile robot , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[99]  Sebastian Wrede,et al.  Attitude of German museum visitors towards an interactive art guide robot , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[100]  Robin R. Murphy,et al.  Review of Human Studies Methods in HRI and Recommendations , 2010, Int. J. Soc. Robotics.

[101]  Shuyin Li,et al.  Multi-modal interaction management for a robot companion , 2007 .

[102]  A. Koller,et al.  Speech Acts: An Essay in the Philosophy of Language , 1969 .

[103]  D. Litman,et al.  Evaluating Spoken Language Systems , 2007 .

[104]  Eric Horvitz,et al.  Models for Multiparty Engagement in Open-World Dialog , 2009, SIGDIAL Conference.

[105]  K. Á. T.,et al.  Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI) , 2000, Natural Language Engineering.

[106]  David Traum,et al.  The Information State Approach to Dialogue Management , 2003 .

[107]  Mikio Nakano,et al.  Understanding Unsegmented User Utterances in Real-Time Spoken Dialogue Systems , 1999, ACL.

[108]  P R Cohen,et al.  The role of voice input for human-machine communication. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[109]  Jean-Luc Gauvain,et al.  The LIMSI ARISE system for train travel information , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[110]  Ulrich Reiser,et al.  Intuitive Human-Machine-Interaction and Implementation on a Household Robot Companion , 2007, HCI.

[111]  James F. Allen,et al.  TRIPS: An Integrated Intelligent Problem-Solving Assistant , 1998, AAAI/IAAI.

[112]  Terry Winograd,et al.  A language/action perspective on the design of cooperative work , 1986, CSCW '86.

[113]  James R. Glass,et al.  Modeling out-of-vocabulary words for robust speech recognition , 2000, INTERSPEECH.

[114]  Pierre-Yves Oudeyer,et al.  A robotic game to evaluate interfaces used to show and teach visual objects to a robot in real world condition , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[115]  David Klotz Modeling Engagement in a Multi-Party Human-Robot Dialog , 2010 .

[116]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[117]  Oliver Lemon,et al.  DIPPER: Description and Formalisation of an Information-State Update Dialogue System Architecture , 2003, SIGDIAL Workshop.

[118]  David Lee,et al.  Exploratory studies on social spaces between humans and a mechanical-looking robot , 2006, Connect. Sci..

[119]  Andreas Kräußling,et al.  Discussion of Exemplary Metrics for Multi-Robot Systems for Formation Navigation , 2005 .

[120]  Terrence Fong,et al.  Collaboration, Dialogue, and Human-Robot Interaction , 2001 .

[121]  Katharina J. Rohlfing,et al.  Systemic Interaction Analysis (SInA) in HRI , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[122]  Candace L. Sidner,et al.  COLLAGEN: A Collaboration Manager for Software Interface Agents , 1998, User Modeling and User-Adapted Interaction.

[123]  Renée Elio,et al.  On Abstract Models and Conversation Policies , 2000, Issues in Agent Communication.

[124]  Martin Rajman,et al.  Rapid Dialogue Prototyping Methodology , 2004, TSD.

[125]  C. Bartneck,et al.  Measuring the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots , 2008, HRI 2008.

[126]  Stanley Peters,et al.  Multi-tasking and Collaborative Activities in Dialogue Systems , 2002, SIGDIAL Workshop.

[127]  Bilge Mutlu,et al.  A Storytelling Robot: Modeling and Evaluation of Human-like Gaze Behavior , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[128]  Marc Hanheide,et al.  Moving from augmented to interactive mapping , 2008 .

[129]  Stanley Peters,et al.  The WITAS multi-modal dialogue system I , 2001, INTERSPEECH.

[130]  Maxine Eskénazi,et al.  A multi-layer architecture for semi-synchronous event-driven dialogue management , 2007, 2007 IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU).

[131]  B. Laeng,et al.  A Redrawn Vandenberg and Kuse Mental Rotations Test - Different Versions and Factors That Affect Performance , 1995, Brain and Cognition.

[132]  James F. Allen,et al.  An architecture for more realistic conversational systems , 2001, IUI '01.

[133]  Volker Schless,et al.  XML-Based Dialogue Descriptions in the GEMINI Project , 2003, Berliner XML Tage.

[134]  Ingo Lütkebohle,et al.  The Task-State Coordination Pattern, with applications in Human-Robot-Interaction , 2010, Learning, Planning and Sharing Robot Knowledge for Human-Robot Interaction.

[135]  Melita Hajdinjak,et al.  The PARADISE Evaluation Framework: Issues and Findings , 2006, Computational Linguistics.

[136]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[137]  Timothy W. Finin,et al.  A semantics approach for KQML—a general purpose communication language for software agents , 1994, CIKM '94.

[138]  Charles Rich,et al.  A Non-Modal Approach to Integrating Dialogue and Action , 2010, AIIDE.

[139]  Roland Siegwart,et al.  A comparative psychophysical and EEG study of different feedback modalities for HRI , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[140]  Horst-Michael Groß,et al.  An approach to multi-modal human-machine interaction for intelligent service robots , 2003, Robotics Auton. Syst..

[141]  Kristy Elizabeth Boyer,et al.  Modeling Dialogue Structure with Adjacency Pair Analysis and Hidden Markov Models , 2009, NAACL.

[142]  Candace L. Sidner,et al.  Where to look: a study of human-robot engagement , 2004, IUI '04.

[143]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[144]  Kerstin Dautenhahn,et al.  Socially intelligent robots: dimensions of human–robot interaction , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[145]  Maxine Eskénazi,et al.  Let's go public! taking a spoken dialog system to the real world , 2005, INTERSPEECH.

[146]  Nate Blaylock,et al.  A problem solving model for collaborative agents , 2002, AAMAS '02.

[147]  Jean Carletta,et al.  Assessing Agreement on Classification Tasks: The Kappa Statistic , 1996, CL.

[148]  Ingo Lütkebohle,et al.  Generic middleware support for coordinating robot software components: The Task-State-Pattern , 2011 .

[149]  Christian Bauckhage,et al.  An active memory as a model for information fusion , 2004 .

[150]  Martin Buss,et al.  Information retrieval system for human-robot communication - Asking for directions , 2009, 2009 IEEE International Conference on Robotics and Automation.

[151]  Friederike Eyssel,et al.  Effects of anticipated human-robot interaction and predictability of robot behavior on perceptions of anthropomorphism , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[152]  Yonghong Yan,et al.  Universal speech tools: the CSLU toolkit , 1998, ICSLP.

[153]  Marc Hanheide,et al.  Mixed-initiative in human augmented mapping , 2009, 2009 IEEE International Conference on Robotics and Automation.

[154]  Matthew W. Crocker,et al.  Visual attention in spoken human-robot interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[155]  Henrik I. Christensen,et al.  Vision-based door-traversal for autonomous mobile robots , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[156]  Anton Leuski,et al.  From domain specification to virtual humans: an integrated approach to authoring tactical questioning characters , 2008, INTERSPEECH.

[157]  Alexander I. Rudnicky,et al.  Sorry, I Didn’t Catch That! , 2008 .

[158]  Takashi Nose,et al.  Grounding New Words on the Physical World in Multi-Domain Human-Robot Dialogues , 2010, AAAI Fall Symposium: Dialog with Robots.

[159]  Staffan Larsson,et al.  GoDiS- An Accommodating Dialogue System , 2000 .

[160]  Ingo Lütkebohle,et al.  Coordination and composition patterns in the "Curious Robot" scenario , 2011 .

[161]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[162]  Douglas B. Moran,et al.  The Open Agent Architecture: A Framework for Building Distributed Software Systems , 1999, Appl. Artif. Intell..

[163]  Ivana Kruijff-Korbayová,et al.  Producing Contextually Appropriate Intonation is an Information-State Based Dialogue System , 2003, EACL.

[164]  Candace L. Sidner,et al.  Explorations in engagement for humans and robots , 2005, Artif. Intell..

[165]  Kurt Konolige,et al.  The Office Marathon: Robust navigation in an indoor office environment , 2010, 2010 IEEE International Conference on Robotics and Automation.

[166]  Carl Burke,et al.  A Flexible Architecture for a Multimodal Robot Control Interface , 2002 .