Providing personalized Internet services by means of context-aware spoken dialogue systems

The widespread use of new mobile technology implementing wireless communications enables a new type of advanced applications to access information services on the Internet. In order to provide services which meet the user needs through intelligent information retrieval, the system must sense and interpret the user environment and the communication context. Though context-awareness is vital to provide services adapted to the user preferences, it cannot be useful if such services are difficult to access. The development of spoken dialogue systems for these applications facilitates interaction in natural language with the environment which is also benefited from contextual information. In this paper, we propose a framework to develop context-aware dialogue systems that dynamically incorporate user specific requirements and preferences as well as characteristics about the interaction environment, in order to improve and personalize web information and services. We have identified the major components for context-aware dialogue systems and placed them within a general-purpose architecture. The framework also describes a representation mode based on a dialogue register in order to share information between the elements of the architecture, and incorporates statistical methodologies for dialogue management in order to reduce the effort required for both the implementation of a new system and the adaptation to a new task. We have evaluated our proposal developing a travel-planning system, and provide a detailed discussion of its positive influence in the quality of the interaction and the information and services provided.

[1]  Sokratis Kartakis,et al.  A design-and-play approach to accessible user interface development in Ambient Intelligence environments , 2010, Comput. Ind..

[2]  Roberto Pieraccini,et al.  Spoken Language Communication with Machines: The Long and Winding Road from Research to Business , 2005, IEA/AIE.

[3]  David Griol,et al.  An Architecture to Provide Context-Aware Services by Means of Conversational Agents , 2010, DCAI.

[4]  Victor Zue,et al.  Multilingual spoken-language understanding in the MIT Voyager system , 1995, Speech Commun..

[5]  Vladimir Lifschitz,et al.  Formalizing Common Sense: Papers by John McCarthy , 1998 .

[6]  Fano Ramparany,et al.  An open context information management infrastructure the IST-amigo project , 2007 .

[7]  Michael F. McTear,et al.  Book Review , 2005, Computational Linguistics.

[8]  Roberto Pieraccini,et al.  A stochastic model of human-machine interaction for learning dialog strategies , 2000, IEEE Trans. Speech Audio Process..

[9]  Kallirroi Georgila,et al.  Quantitative Evaluation of User Simulation Techniques for Spoken Dialogue Systems , 2005, SIGDIAL.

[10]  Hui Ye,et al.  Agenda-Based User Simulation for Bootstrapping a POMDP Dialogue System , 2007, NAACL.

[11]  Antonio F. Gómez-Skarmeta,et al.  Implementation and Evaluation of a Location-Aware Wireless Multi-agent System , 2004, EUC.

[12]  Steve J. Young,et al.  A survey of statistical user simulation techniques for reinforcement-learning of dialogue management strategies , 2006, The Knowledge Engineering Review.

[13]  Bill N. Schilit,et al.  Context-aware computing applications , 1994, Workshop on Mobile Computing Systems and Applications.

[14]  Rohit Kumar,et al.  Conquestâ - An Open-Source Dialog System for Conferences , 2007, HLT-NAACL.

[15]  Hamideh Afsarmanesh,et al.  Virtual Community Support In Telecare , 2003, PRO-VE.

[16]  George Coulouris,et al.  Middleware Support for Context-Aware Multimedia Applications , 2001, DAIS.

[17]  Encarna Segarra,et al.  The Incorporation of Confidence Measures to Language Understanding , 2003, TSD.

[18]  John McCarthy,et al.  Generality in artificial intelligence , 1987, Resonance.

[19]  Joelle Pineau,et al.  Spoken Dialogue Management Using Probabilistic Reasoning , 2000, ACL.

[20]  Andreas Stolcke,et al.  Dialogue act modeling for automatic tagging and recognition of conversational speech , 2000, CL.

[21]  Hui Ye,et al.  The Hidden Information State Approach to Dialog Management , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[22]  Ramón López-Cózar,et al.  The role of spoken language dialogue interaction in intelligent environments , 2009, J. Ambient Intell. Smart Environ..

[23]  James R. Glass,et al.  Exploiting Context Information in Spoken Dialogue Interaction with Mobile Devices ? , 2022 .

[24]  Schahram Dustdar,et al.  A survey on context-aware web service systems , 2009, Int. J. Web Inf. Syst..

[25]  Steve J. Young,et al.  Error simulation for training statistical dialogue systems , 2007, 2007 IEEE Workshop on Automatic Speech Recognition & Understanding (ASRU).

[26]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[27]  Victor Zue,et al.  Dialogue-Oriented Review Summary Generation for Spoken Dialogue Recommendation Systems , 2010, NAACL.

[28]  Till Christopher Lech,et al.  AmbieAgents: a scalable infrastructure for mobile and context-aware information services , 2005, AAMAS '05.

[29]  David Griol,et al.  Acquiring and Evaluating a Dialog Corpus through a Dialog Simulation Technique , 2007, SIGdial.

[30]  Katsumi Nihei,et al.  Context sharing platform , 2004 .

[31]  Marvin Minsky,et al.  A framework for representing knowledge , 1974 .

[32]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[33]  Wolfgang Minker,et al.  Proactive Spoken Dialogue Interaction in Multi-Party Environments , 2010 .

[34]  Barry A. T. Brown,et al.  Building a Context Sensitive Telephone: Some Hopes and Pitfalls for Context Sensitive Computing , 2004, Computer Supported Cooperative Work (CSCW).

[35]  Josephine Antoniou,et al.  Adaptive network-aided session support in context-aware converged mobile networks , 2012, Int. J. Auton. Adapt. Commun. Syst..

[36]  David Griol,et al.  A statistical approach to spoken dialog systems design and evaluation , 2008, Speech Commun..

[37]  Hua Ai,et al.  Comparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users , 2007, SIGDIAL.

[38]  Pat Langley,et al.  A Personalized System for Conversational Recommendations , 2011, J. Artif. Intell. Res..

[39]  Weijia Jia,et al.  Context-Awareness in Mobile Web Services , 2004, ISPA.

[40]  Richard Fikes,et al.  The role of frame-based representation in reasoning , 1985, CACM.

[41]  Hakan Melin,et al.  CTT-bank: A speech controlled telephone banking system - an initial evaluation , 2007 .

[42]  Steve Young,et al.  The statistical approach to the design of spoken dialogue systems , 2003 .

[43]  José Rouillard Web services and speech-based applications around VoiceXML , 2007, J. Networks.

[44]  Victor Zue,et al.  JUPlTER: a telephone-based conversational interface for weather information , 2000, IEEE Trans. Speech Audio Process..

[45]  Roberto Pieraccini,et al.  Automating spoken dialogue management design using machine learning: An industry perspective , 2008, Speech Commun..

[46]  José Bravo,et al.  Towards the ubiquitous visualization: Adaptive user-interfaces based on the Semantic Web , 2011, Interact. Comput..

[47]  Fabien L. Gandon,et al.  Ambient Intelligence: The MyCampus Experience , 2005 .

[48]  Nuno J. Mamede,et al.  Ambient Intelligence Interaction via Dialogue Systems , 2010 .

[49]  Cláudio de Souza Baptista,et al.  A context-aware system based on service-oriented architecture , 2006, 20th International Conference on Advanced Information Networking and Applications - Volume 1 (AINA'06).

[50]  Michael F. McTear,et al.  Spoken Dialogue Technology , 2004, Springer London.

[51]  George N. Prezerakos,et al.  Model-driven Composition of Context-aware Web Services Using ContextUML and Aspects , 2007, IEEE International Conference on Web Services (ICWS 2007).

[52]  Euiho Suh,et al.  Packet-based context aware system to determine information system user's context , 2008, Expert Syst. Appl..

[53]  Teruko Mitamura,et al.  Context-aware Dialog Strategies for Multimodal Mobile Dialog Systems , 2006 .

[54]  Jadwiga Indulska,et al.  Modeling Context Information in Pervasive Computing Systems , 2002, Pervasive.

[55]  George L. Kovács,et al.  Some Aspects of Ambient Intelligence , 2006 .