Multimodal Dialogue for Ambient Intelligence and Smart Environments

Ambient Intelligence (AmI) and Smart Environments (SmE) are based on three foundations: ubiquitous computing, ubiquitous communication and intelligent adaptive interfaces [41]. This type of systems consists of a series of interconnected computing and sensing devices which surround the user pervasively in his environment and are invisible to him, providing a service that is dynamically adapted to the interaction context, so that users can naturally interact with the system and thus perceive it as intelligent.

[1]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. II. Finger touch feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[2]  Boris E. R. de Ruyter,et al.  Case study: bringing social intelligence into home dialogue systems , 2005, INTR.

[3]  Mahadev Satyanarayanan.  Challenges in Implementing a Context-Aware System , 2002 .

[4]  Nicole Novielli,et al.  User modeling and adaptation in health promotion dialogs with an animated character , 2006, J. Biomed. Informatics.

[5]  Gregory D. Abowd,et al.  The context toolkit: aiding the development of context-enabled applications , 1999, CHI '99.

[6]  Wolfgang Wahlster,et al.  SmartKom: Foundations of Multimodal Dialogue Systems , 2006, SmartKom.

[7]  Iryna Gurevych,et al.  Towards Context-adaptive Utterance Interpretation , 2002, SIGDIAL Workshop.

[8]  Nati Herrasti,et al.  GENIO: an ambient intelligence application in home automation and entertainment environment , 2005, sOc-EUSAI '05.

[9]  Marilyn A. Walker,et al.  Evaluating Dialogue Strategies in Multimodal Dialogue Systems , 2005 .

[10]  Joëlle Coutaz,et al.  A generic platform for addressing the multimodal challenge , 1995, CHI '95.

[11]  Norman M. Sadeh,et al.  Applying case-based reasoning and multi-agent intelligent system to context-aware comparative shopping , 2004, Decis. Support Syst..

[12]  Christos Doulkeridis,et al.  CASD: Management of a context-aware service directory , 2008, Pervasive Mob. Comput..

[13]  Eduard H. Hovy,et al.  Automated Discourse Generation Using Discourse Structure Relations , 1993, Artif. Intell..

[14]  Kristiina Jokinen.  Natural Interaction in Spoken Dialogue Systems , .

[15]  A.W. Black,et al.  Using speech in noise to improve understandability for elderly listeners , 2005, IEEE Workshop on Automatic Speech Recognition and Understanding, 2005..

[16]  Mitsuru Ishizuka,et al.  Persona Effect Revisited --- Using Bio-signals to Measure and Reflect the Impact of Character-bas , 2003 .

[17]  Ali A. Nazari Shirehjini,et al.  A generic UPnP architecture for ambient intelligence meeting rooms and a control point allowing for integrated 2D and 3D interaction , 2005, sOc-EUSAI '05.

[18]  Masahiro Araki,et al.  Spoken, Multilingual and Multimodal Dialogue Systems: Development and Assessment , 2005 .

[19]  Wolfgang Wahlster,et al.  Ambient Intelligence in Edutainment: Tangible Interaction with Life-Like Exhibit Guides , 2005, INTETAIN.

[20]  Niels Ole Bernsen,et al.  Evaluation and usability of multimodal spoken language dialogue systems , 2004, Speech Commun..

[21]  Pablo A. Haya,et al.  A Plug and Play Spoken Dialogue Interface for Smart Environments , 2004, CICLing.

[22]  Francisco J. Gomez-Arribas,et al.  Interact-DDM: a solution for the integration of domestic devices on network management platforms , 2003, IFIP/IEEE Eighth International Symposium on Integrated Network Management, 2003..

[23]  Thomas Brown,et al.  Context awareness in a handheld exercise agent , 2009, Pervasive Mob. Comput..

[24]  Robert Dale,et al.  Handbook of Natural Language Processing , 2001, Computational Linguistics.

[25]  Sebastian Möller,et al.  Evaluating the speech output component of a smart-home system , 2006, Speech Commun..

[26]  Kun Yang,et al.  Towards a Model-Driven Approach for Ontology-Based Context-Aware Application Development: A Case Study , 2007, Fourth International Workshop on Model-Based Methodologies for Pervasive and Embedded Software (MOMPES'07).

[27]  Bruno Bouzy,et al.  Using the Object Oriented Paradigm to Model Context in Computer Go , 1997 .

[28]  Eli Hagen,et al.  Adaptation of an automotive dialogue system to users’ expertise and evaluation of the system , 2006, SIGDIAL.

[29]  Jadwiga Indulska,et al.  Developing context-aware pervasive computing applications: Models and approach , 2006, Pervasive Mob. Comput..

[30]  David F. McAllister,et al.  Lip synchronization of speech , 1997, AVSP.

[31]  Christoph Lauer,et al.  MIAMM - Multidimensional Information Access using Multiple Modalites , 2001 .

[32]  Ramón López-Cózar,et al.  Influence of contextual information in emotion annotation for spoken dialogue systems , 2008, Speech Commun..

[33]  Niels Ole Bernsen.  User Modelling in the Car , 2003, User Modeling.

[34]  José L. Encarnação,et al.  Ambient Intelligence: Towards Smart Appliance Ensembles , 2005, From Integrated Publication and Information Systems to Virtual Information and Knowledge Environments.

[35]  Bob Carpenter,et al.  The logic of typed feature structures , 1992 .

[36]  H. P Nii,et al.  Blackboard Systems , 1986 .

[37]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[38]  Esther Levin,et al.  Dialog Design for User Adaptation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[39]  Paul Deléglise,et al.  Lip-reading based on a fully automatic statistical model , 2002, INTERSPEECH.

[40]  Euiho Suh,et al.  Packet-based context aware system to determine information system user's context , 2008, Expert Syst. Appl..

[41]  Albrecht Schmidt,et al.  Ubiquitous computing - computing in context , 2003 .

[42]  Nicole Beringer,et al.  End-to-End Evaluation of Multimodal Dialogue Systems – can we Transfer Established Methods? , 2002, LREC.

[43]  Stanley Peters,et al.  The WITAS multi-modal dialogue system I , 2001, INTERSPEECH.

[44]  Claudia Linnhoff-Popien,et al.  A Context Modeling Survey , 2004 .

[45]  Jason Pascoe,et al.  The stick-e note architecture: extending the interface beyond the user , 1997, IUI '97.

[46]  Mitsuru Ishizuka,et al.  Persona Effect Revisited , 2003, IVA.

[47]  Shinjiro Kawato,et al.  Just blink your eyes: a head-free gaze tracking system , 2003, CHI Extended Abstracts.

[48]  D. Corkill.  Blackboard Systems , 1991 .

[49]  Janet E. Cahn,et al.  Improvising Linguistic Style: Social and Affective Bases for Agents. , 1997 .

[50]  Marilyn A. Walker,et al.  Evaluating spoken dialogue agents with PARADISE: Two case studies , 1998, Comput. Speech Lang..

[51]  Peter Steenkiste,et al.  Avoiding Privacy Violations Caused by Context-Sensitive Services , 2006, PerCom.

[52]  Rajeev Sharma,et al.  Understanding Gestures in Multimodal Human Computer Interaction , 2000, Int. J. Artif. Intell. Tools.

[53]  M. Mehta,et al.  MULTIMODAL INPUT FUSION IN HUMAN-COMPUTER INTERACTION On the Example of the NICE Project , 2003 .

[54]  Alexander H. Waibel,et al.  Real-Time Face and Facial Feature Tracking and Applications , 1998, AVSP.

[55]  Jens Edlund,et al.  Adapt - a multimodal conversational dialogue system in an apartment domain , 2000, INTERSPEECH.

[56]  Karun B. Shimoga,et al.  A survey of perceptual feedback issues in dexterous telemanipulation. I. Finger force feedback , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[57]  R. Porzel,et al.  Contextual utterance interpretation , 2002 .

[58]  Kent Larson,et al.  A living laboratory for the design and evaluation of ubiquitous computing technologies , 2005, CHI Extended Abstracts.

[59]  Erik G. Nilsson,et al.  User Profiles for Adapting Speech Support in the Opera Web Browser to Disabled Users , 2006, Universal Access in Ambient Intelligence Environments.

[60]  Nathalie Bricon-Souf,et al.  Context awareness in health care: A review , 2007, Int. J. Medical Informatics.

[61]  Chafic Mokbel,et al.  Towards multilingual speech recognition using data driven source/target acoustical units association , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[62]  Till Plumbaum,et al.  A Framework for Ubiquitous User Modeling , 2007, 2007 IEEE International Conference on Information Reuse and Integration.

[63]  Diane J. Litman,et al.  Modelling User Satisfaction and Student Learning in a Spoken Dialogue Tutoring System with Generic, Tutoring, and User Affect Parameters , 2006, NAACL.

[64]  Jadwiga Indulska,et al.  Modeling Context Information in Pervasive Computing Systems , 2002, Pervasive.

[65]  Joyce Ho,et al.  Using context-aware computing to reduce the perceived burden of interruptions from mobile devices , 2005, CHI.

[66]  George L. Kovács,et al.  Some Aspects of Ambient Intelligence , 2006 .

[67]  Boris E. R. de Ruyter,et al.  Benefits of Social Intelligence in Home Dialogue Systems , 2005, INTERACT.

[68]  Nicole Beringer,et al.  PROMISE - A Procedure for Multimodal Interactive System Evaluation , 2002 .

[69]  Biing-Hwang Juang,et al.  Fundamentals of speech recognition , 1993, Prentice Hall signal processing series.

[70]  Nigel Gilbert,et al.  Simulating speech systems , 1991 .

[71]  Mahadev Satyanarayanan.  IEEE Pervasive Computing: From the Editor in Chief - Challenges in Implementing a Context-Aware System , 2002, IEEE Distributed Syst. Online.

[72]  Marilyn A. Walker,et al.  MATCH: An Architecture for Multimodal Dialogue Systems , 2002, ACL.

[73]  Jean-Henry Morin,et al.  SAMBA - An Agent architecture for Ambient Intelligence Elements Interoperability , 2007, IESA.

[75]  Sebastian Möller,et al.  INSPIRE: Evaluation of a Smart-Home System for Infotainment Management and Device Control , 2004, LREC.

[76]  K. Takahashi,et al.  A Discrete HMM for Online Handwriting Recognition , 2000, Int. J. Pattern Recognit. Artif. Intell..