The CALIMACO Multimodal System: Providing Enhanced Library Services Using Mobile Devices

Multimodal conversational agents have became a strong alternative to enhance educational systems with intelligent communicative capabilities. The combination of these systems with smart mobile devices have promoted in recent years more sophisticated human-machine interfaces that provide a more engaging and human-like relationship between users and the system. Among the different educational application domains, this combination allows developing enhanced digital libraries containing new types of multimedia contents, providing new interaction possibilities, and adapting this interaction taking into account the specific users requirements and preferences. In this paper we propose the practical application of multimodal conversational agents to develop advanced University Digital Libraries (UDL) adapted to the new interaction scenarios of mobile devices. Our proposal integrates features of Android APIs on a modular architecture that emphasizes interaction management to create robust applications, easily updated and adapted to the user.

[1]  Roberto Pieraccini.  The Voice in the Machine: Building Computers That Understand Speech , 2012 .

[2]  Marc Cavazza,et al.  How was your day?: a companion ECA , 2010, AAMAS.

[3]  Albert A. Angehrn,et al.  Conversational Agents for Advanced Learning: Applications and Research , 2001 .

[4]  Evgenia Vassilakaki,et al.  Multilingual Digital Libraries: A review of issues in system-centered and user-centered studies, information retrieval and user behavior , 2013 .

[5]  Susan Bull,et al.  CALMsystem: A Conversational Agent for Learner Modelling , 2007, Knowl. Based Syst..

[6]  Ramón López-Cózar,et al.  A domain-independent statistical methodology for dialog management in spoken dialog systems , 2014, Comput. Speech Lang..

[7]  Zoraida Callejas,et al.  Voice Application Development for Android , 2013 .

[8]  Ying-Hong Wang,et al.  Enhanced Semantic Question Answering System for e-Learning Environment , 2007, 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW'07).

[9]  Sebastian Möller,et al.  Reliable Evaluation of Multimodal Dialogue Systems , 2009, HCI.

[10]  David Griol,et al.  A Proposal to Create Learning Environments in Virtual Worlds Integrating Advanced Educative Resources , 2012, J. Univers. Comput. Sci..

[11]  Robert Graham,et al.  Subjective assessment of speech-system interface usability , 2001, INTERSPEECH.

[12]  Luke K. Fryer,et al.  Bots as Language Learning Tools , 2006 .

[13]  María Dolores Rodríguez-Moreno,et al.  Efficient Services Management in Libraries using AI and Wireless techniques , 2014, Expert Syst. Appl..

[14]  Brady Clark,et al.  Responding to Student Uncertainty in Spoken Tutorial Dialogue Systems , 2006, Int. J. Artif. Intell. Educ..

[15]  Hsin-Liang Chen,et al.  An open source library system and public library users: Finding and using library collections , 2012 .