Developing multimodal conversational agents for an enhanced e-learning experience

Conversational agents have become a strong alternative to enhance educational systems with intelligent communicative capabilities, provide motivation and engagement, and increment significant learning and helping in the acquisition of meta-cognitive skills. In this paper, we present Geranium, a multimodal conversational agent that helps children to appreciate and protect their environment. The system, which integrates an interactive chatbot, has been developed by means of a modular and scalable framework that eases building pedagogic conversational agents that can interact with the students using speech and natural language.

[1]  Ning Wang,et al.  The Politeness Effect in an Intelligent Foreign Language Tutoring System , 2008, Intelligent Tutoring Systems.

[2]  Steve J. Young,et al.  Partially observable Markov decision processes for spoken dialog systems , 2007, Comput. Speech Lang..

[3]  Bruce Edmonds,et al.  A conversational intelligent tutoring system to automatically predict learning styles , 2012, Comput. Educ..

[4]  Eric Atwell,et al.  Fostering Language Learner Autonomy Through Adaptive Conversation Tutors , 2007 .

[5]  Maarten Sierhuis,et al.  Are You Talking to Me? Dialogue Systems Supporting Mixed Teams of Humans and Robots , 2006, AAAI Fall Symposium: Aurally Informed Performance.

[6]  Luke K. Fryer,et al.  Bots as Language Learning Tools , 2006 .

[7]  Futoshi Asano,et al.  Spoken Language Interface of the Jijo-2 Office Robot , 2001, ISRR.

[8]  C. Vaquero,et al.  VOCALIZA: AN APPLICATION FOR COMPUTER-AIDED SPEECH THERAPY IN SPANISH LANGUAGE , 2006 .

[9]  David Griol,et al.  Bringing together commercial and academic perspectives for the development of intelligent AmI interfaces , 2012, J. Ambient Intell. Smart Environ..

[10]  Arthur C. Graesser,et al.  AutoTutor: an intelligent tutoring system with mixed-initiative dialogue , 2005, IEEE Transactions on Education.

[11]  Javier Bajo,et al.  Social-based planning model for multiagent systems , 2011, Expert Syst. Appl..

[12]  Miguel Angel Salichs,et al.  End-user programming of a social robot by dialog , 2011, Robotics Auton. Syst..

[13]  Diane J. Litman,et al.  ITSPOKE: An Intelligent Tutoring Spoken Dialogue System , 2004, NAACL.

[14]  Arthur C. Graesser,et al.  Teaching Tactics and Dialog in AutoTutor , 2001 .

[15]  Norman I. Badler,et al.  Creating Interactive Virtual Humans: Some Assembly Required , 2002, IEEE Intell. Syst..

[16]  Ying-Hong Wang,et al.  Enhanced Semantic Question Answering System for e-Learning Environment , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[17]  Javier Bajo,et al.  S-MAS: An adaptive hierarchical distributed multi-agent architecture for blocking malicious SOAP messages within Web Services environments , 2011 .

[18]  Vincent Aleven,et al.  Evaluating the Effectiveness of a Tutorial Dialogue System for Self-Explanation , 2004, Intelligent Tutoring Systems.

[19]  Thomas Bub,et al.  The Verbmobil prototype system – a software engineering perspective , 1999, Natural Language Engineering.

[20]  T. Bickmore.  Relational agents : effecting change through human-computer relationships , 2003 .

[21]  David Griol,et al.  A Proposal to Create Learning Environments in Virtual Worlds Integrating Advanced Educative Resources , 2012, J. Univers. Comput. Sci..

[22]  Brady Clark,et al.  Responding to Student Uncertainty in Spoken Tutorial Dialogue Systems , 2006, Int. J. Artif. Intell. Educ..

[23]  Candace L. Sidner,et al.  Where to look: a study of human-robot engagement , 2004, IUI '04.

[24]  Zoraida Callejas,et al.  Voice Application Development for Android , 2013 .

[25]  Susan Bull,et al.  Children's Interactions with Inspectable and Negotiated Learner Models , 2008, Intelligent Tutoring Systems.

[26]  Naoyuki Kanda,et al.  A multi-expert model for dialogue and behavior control of conversational robots and agents , 2011, Knowl. Based Syst..

[27]  Paul McKellips,et al.  Are we there yet? , 2014, Lab Animal.

[28]  Britta Wrede,et al.  Why and How to Model Multi-Modal Interaction for a Mobile Robot Companion , 2007, Interaction Challenges for Intelligent Assistants.

[29]  Javier Bajo,et al.  A multi-agent architecture for distributed services and applications , 2009 .

[30]  Johanna D. Moore,et al.  A comparative evaluation of socratic versus didactic tutoring , 2001 .

[31]  Eric Atwell,et al.  Fostering language learner autonomy via adaptive conversation tutors , 2007 .

[32]  Chi-Jen Lin,et al.  Redefining the learning companion: the past, present, and future of educational agents , 2003, Comput. Educ..

[33]  G. Tsaganou,et al.  Dialogue-Based Reflective System for Historical Text Comprehension , 2003 .

[34]  Roberto Pieraccini.  The Voice in the Machine: Building Computers That Understand Speech , 2012 .

[35]  Marc Cavazza,et al.  How was your day?: a companion ECA , 2010, AAMAS.