Autonomic Communication in Pervasive Multimodal Multimedia Computing System

Autonomic communication in a computing system analyzes the individual system element as it is affected by and affects other elements. In the human-machine communication aspect, the autonomic system performs its services autonomously, adjusting the behavior of its services to suit what the user might request implicitly or explicitly. The pervasive multimodal multimedia computing system aims at realizing anytime, anywhere computing. Its autonomic communication includes the protocols that selects, on behalf of the user, the modalities and media devices that are appropriate to the given interaction context. The modalities are the modes of interaction (i.e. for data input and output) between the user and the computer while the media devices are the physical devices that are used to support the chosen modalities. The interaction context itself is the combined user, environment, and system contexts. In this paper, we present the autonomic communication protocols involved in the detection of interaction context and the multimodal computing system’s corresponding adaptation. The heart of this paradigm’s design is the machine learning’s knowledge acquisition and the use of the layered virtual machine for definition and detection of interaction context.

[1]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[2]  Joëlle Coutaz,et al.  Le contexteur: une abstraction logicielle pour la réalisation de systèmes interactifs sensibles au contexte , 2002, IHM '02.

[3]  Witold Pedrycz,et al.  Ambient Intelligence, Wireless Networking, And Ubiquitous Computing , 2006 .

[4]  Sharon L. Oviatt,et al.  Perceptual user interfaces: multimodal interfaces that process what comes naturally , 2000, CACM.

[5]  Chokri Ben Amar,et al.  Context Modeling and Context-Aware Service Adaptation for Pervasive Computing Systems , 2008 .

[6]  David Garlan,et al.  Project Aura: Toward Distraction-Free Pervasive Computing , 2002, IEEE Pervasive Comput..

[7]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[8]  David R. Morse,et al.  Enhanced Reality Fieldwork: the Context Aware Archaeological Assistant , 1997 .

[9]  Simon Lucey,et al.  Audio-visual Speech Processing , 2002 .

[10]  Amar Ramdane-Cherif,et al.  A Paradigm of a Pervasive Multimodal Multimedia Computing System for the Visually-Impaired Users , 2006, GPC.

[11]  C. Tadj,et al.  Dynamic multi-agent architecture for multimedia multimodal dialogs , 2002, Proceedings. IEEE Workshop on Knowledge Media Networking.

[12]  Andy Hopper,et al.  A new location technique for the active office , 1997, IEEE Wirel. Commun..

[13]  S. P A Ringland,et al.  Multimodality — The Future of the Wireless User Interface , 2003 .

[14]  Sharon L. Oviatt,et al.  Taming recognition errors with a multimodal interface , 2000, CACM.

[15]  Jason Pascoe,et al.  Adding generic contextual capabilities to wearable computers , 1998, Digest of Papers. Second International Symposium on Wearable Computers (Cat. No.98EX215).

[16]  Sharon L. Oviatt,et al.  Designing the User Interface for Multimodal Speech and Pen-Based Gesture Applications: State-of-the-Art Systems and Future Research Directions , 2000, Hum. Comput. Interact..

[17]  Kaveh Pahlavan.  Principles Of Wireless Networks , 2001 .

[18]  Mahadev Satyanarayanan,et al.  Pervasive computing: vision and challenges , 2001, IEEE Wirel. Commun..

[19]  Mahadev Satyanarayanan,et al.  Mobile Information Access , 1996 .

[20]  Giuliano Antoniol,et al.  A distributed architecture for dynamic analyses on user-profile data , 2004, Eighth European Conference on Software Maintenance and Reengineering, 2004. CSMR 2004. Proceedings..

[21]  David Garlan,et al.  Context is key , 2005, CACM.

[22]  Antje Schweitzer,et al.  Multimodal Speech Synthesis , 2006, SmartKom.

[23]  Philip R. Cohen,et al.  MULTIMODAL INTERFACES THAT PROCESS WHAT COMES NATURALLY , 2000 .

[24]  Ken Shumate,et al.  Layered virtual machine/object-oriented design , 1988, WADAS '88.

[25]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[26]  Frédéric Delmond,et al.  The user profile for the virtual home environment , 2003, IEEE Commun. Mag..

[27]  SatyanarayananMahadev.  Scalable, Secure, and Highly Available Distributed File Access , 1990 .

[28]  Peter J. Brown,et al.  Context-aware applications: from the laboratory to the marketplace , 1997, IEEE Wirel. Commun..

[29]  Mahadev Satyanarayanan.  Accessing information on demand at any location. Mobile information access , 1996, IEEE Wirel. Commun..

[30]  Gregory D. Abowd,et al.  An Architecture to Support Context-Aware Applications , 1999 .

[31]  Amar Ramdane-Cherif,et al.  Design of an Incremental Machine Learning Component of a Ubiquitous Multimodal Multimedia Computing System , 2006, 2006 IEEE International Conference on Wireless and Mobile Computing, Networking and Communications.

[32]  J. Coutaz,et al.  The Contextor Infrastructure for Context-Aware Computing , 2004 .

[33]  Samir Benarif,et al.  Generic Multimedia Multimodal Agents Paradigms and Their Dynamic Reconfiguration at the Architectural Level , 2004, EURASIP J. Adv. Signal Process..

[34]  Bill N. Schilit,et al.  Disseminating active map information to mobile hosts , 1994, IEEE Network.

[35]  Mahadev Satyanarayanan,et al.  Scalable, secure, and highly available distributed file access , 1990, Computer.

[36]  Amar Ramdane-Cherif,et al.  Infrastructure of a context adaptive and pervasive multimodal multimedia computing system , 2009 .