Multimodal human-robot interaction with Chatterbot system: Extending AIML towards supporting embodied interactions

The research objective of this work is to realize multimodal human-robot interaction based on light-weight Chatterbot system. The dialogue system is integrated into SIGVerse system with immersive multimodal interfaces to achieve interaction in an embodied virtual environment. To validate the feasibility of the proposed design, the actual AIML implementations are described to illustrate (a) Gesture Inputs, (b) Emotional Expressions, (c) Robot Interactive Learning, and (d) Interactive Learning towards Symbol Grounding in multimodal human-robot interaction.

[1]  Magdalena D. Bugajska,et al.  Building a Multimodal Human-Robot Interface , 2001, IEEE Intell. Syst..

[2]  Timothy Bickmore,et al.  Health dialog systems for patients and consumers , 2006, J. Biomed. Informatics.

[3]  Yuichiro Yoshikawa,et al.  Simulator platform that enables social interaction simulation — SIGVerse: SocioIntelliGenesis simulator , 2010, 2010 IEEE/SICE International Symposium on System Integration.

[4]  Alexander H. Waibel,et al.  Enabling Multimodal Human–Robot Interaction for the Karlsruhe Humanoid Robot , 2007, IEEE Transactions on Robotics.

[5]  Keeley A. Crockett,et al.  Systems Engineering and Conversational Agents , 2011 .

[6]  Jeffrey Too Chuan Tan,et al.  Extending chatterbot system into multimodal interaction framework with embodied contextual understanding , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[7]  Jeffrey Too Chuan Tan,et al.  SIGVerse - A cloud computing architecture simulation platform for social human-robot interaction , 2012, 2012 IEEE International Conference on Robotics and Automation.

[8]  Justine Cassell,et al.  Embodied Conversational Agents: Representation and Intelligence in User Interfaces , 2001, AI Mag..

[9]  Giovanni Pilato,et al.  A Chat-bot based Multimodal Virtual Guide for Cultural Heritage Tours , 2006, PSC.

[10]  Richard S. Wallace,et al.  The Anatomy of A.L.I.C.E. , 2009 .

[11]  R. Pirrone,et al.  GAIML: A New Language for Verbal and Graphical Interaction in Chatbots , 2008, 2008 International Conference on Complex, Intelligent and Software Intensive Systems.