A Framework to Develop Adaptive Multimodal Dialog Systems for Android-Based Mobile Devices

Mobile devices programming has emerged as a new trend in software development. The main developers of operating systems for such devices have provided APIs for developers to implement their own applications, including different solutions for developing voice control. Android, the most popular alternative among developers, offers libraries to build interfaces including different resources for graphical layouts as well as speech recognition and text-to-speech synthesis. Despite the usefulness of such classes, there are no strategies defined for multimodal interface development for Android systems, and developers create ad-hoc solutions that make apps costly to implement and difficult to compare and maintain. In this paper we propose a framework to facilitate the software engineering life cycle for multimodal interfaces in Android. Our proposal integrates the facilities of the Android API in a modular architecture that emphasizes interaction management and context-awareness to build sophisticated, robust and maintainable applications.

[1]  Min-Jen Tsai.  The VoiceXML dialog system for the e-commerce ordering service , 2005, Proceedings of the Ninth International Conference on Computer Supported Cooperative Work in Design, 2005..

[2]  Simon Dobrisek,et al.  A voice-driven web browser for blind people , 2003, INTERSPEECH.

[3]  Michael Kearns,et al.  CobotDS: a spoken dialogue system for chat , 2002, AAAI/IAAI.

[4]  David Griol,et al.  AN AUTOMATIC DIALOG SIMULATION TECHNIQUE TO DEVELOP AND EVALUATE INTERACTIVE CONVERSATIONAL AGENTS , 2013, Appl. Artif. Intell..

[5]  Roberto Pieraccini.  The Voice in the Machine: Building Computers That Understand Speech , 2012 .

[6]  Yasuhisa Niimi,et al.  Spoken Dialog System for Database Access on Internet , 1997 .

[7]  E. Agree,et al.  The potential for technology to enhance independence for those aging with a disability. , 2014, Disability and health journal.

[8]  David Griol,et al.  A statistical simulation technique to develop and evaluate conversational agents , 2013, AI Commun..

[9]  Joseph Polifroni,et al.  Towards the automatic generation of mixed-initiative dialogue systems from web content , 2003, INTERSPEECH.

[10]  Ramón López-Cózar,et al.  A domain-independent statistical methodology for dialog management in spoken dialog systems , 2014, Comput. Speech Lang..

[11]  Pier Luigi Emiliani,et al.  An innovative framework to support multimodal interaction with Smart Environments , 2012, Expert Syst. Appl..

[12]  Zoraida Callejas,et al.  Voice Application Development for Android , 2013 .

[13]  Emilio Corchado,et al.  Recent trends in intelligent data analysis , 2014, Neurocomputing.