Multimodal Interaction in Distributed and Ubiquitous Computing

This paper presents a multimodal, service-oriented architecture based on a distributed implementation of W3C’s Multimodal Architecture and Interfaces applied to ubiquitous computing. The specific goal is to create a platform able to provide multimodal interactions between people with functional diversity and several semantic services developed by third-party companies and consumed through a display, in order to make content more accessible and interactive. The general purpose of this research is the development and deployment of urban, ubiquitous services for people living in or visiting a city. And the motivating scenario behind the design and development of the multimodal platform and semantic services is one in which people use media poles and confidently interoperate with the surrounding environment in a multimodal way.

[1]  James H. Aylor,et al.  Computer for the 21st Century , 1999, Computer.

[2]  Li Deng,et al.  Speech and Language Processing for Multimodal Human-Computer Interaction , 2004, J. VLSI Signal Process..

[3]  Julio Abascal,et al.  Managing Intelligent Services for People with Disabilities and Elderly People , 2009, HCI.

[4]  Julian Padget,et al.  Combining Organisational and Coordination Theory with Model Driven Approaches to Develop Dynamic, Flexible, Distributed Business Systems , 2009, DigiBiz.

[5]  Alfred Kobsa,et al.  Personalised hypermedia presentation techniques for improving online customer relationships , 2001, The Knowledge Engineering Review.

[6]  Antonella De Angeli,et al.  Integration and synchronization of input modes during multimodal human-computer interaction , 1997, CHI.

[7]  Joëlle Coutaz,et al.  A design space for multimodal systems: concurrent processing and data fusion , 1993, INTERCHI.

[8]  Li Deng,et al.  MiPad: a multimodal interaction prototype , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  Kalle Lyytinen,et al.  Issues and Challenges in Ubiquitous Computing , 2002 .

[10]  Luigi Ceccaroni,et al.  PaTac: Urban, Ubiquitous, Personalized Services for Citizens and Tourists , 2009, 2009 Third International Conference on Digital Society.

[11]  Younghee Jung,et al.  How to look beyond what users say that they want , 2007, CHI Extended Abstracts.

[12]  Li Deng,et al.  Distributed speech processing in miPad's multimodal user interface , 2002, IEEE Trans. Speech Audio Process..

[13]  Alfred Kobsa,et al.  Tailoring the Presentation of Plans to Users' Knowledge and Capabilites , 2003, KI.