Reference architecture for 3G thin client multimodal applications

As 3G mobile networks emerge, they offer the potential to develop new and enhanced services that have been previously impractical over 2G networks. Many of these value added services focus on the higher data rates supported by 3G. An additional capability of 3G networks is the multicall supplementary service, which enables the transmission of both voice and data simultaneously. This capability can be leveraged to provide a multimodal user interface. We propose a browser (thin) client reference architecture for supporting a conversational multimodal application. We observe that such an architecture possesses several additional challenges when compared to a thick client application approach. We demonstrate the feasibility of our architecture with our prototype results, and devise a reference architecture for commercial implementations that enables users to interact with applications using simultaneous voice and data over 3G networks, without the restriction of software deployed to the device.

[1]  Michael Pucher,et al.  Architecture for adaptive multimodal dialog systems based on voiceXML , 2001, INTERSPEECH.

[2]  Tapio Frantti,et al.  The multicall service to support multimedia services in the UMTS networks , 2001, Proceedings 27th EUROMICRO Conference. 2001: A Net Odyssey.

[3]  Li Deng,et al.  MiPad: a multimodal interaction prototype , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[4]  Salim Roukos,et al.  Phrase splicing and variable substitution using the IBM trainable speech synthesis system , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[5]  Michael Cohen,et al.  Narrowcasting operations for mobile phone CVE chatspace avatars , 2003 .

[6]  Feng Liu,et al.  A distributed multimodal dialogue system based on dialogue system and web convergence , 2002, INTERSPEECH.

[7]  Ea-Ee Jan,et al.  The IBM conversational telephony system for financial applications , 1999, EUROSPEECH.

[8]  Sharon L. Oviatt,et al.  Ten myths of multimodal interaction , 1999, Commun. ACM.

[9]  Feng Liu,et al.  An architecture of wireless Web and dialogue system convergence for multimodal service interaction over converged networks , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[10]  José Rouillard.  A multimodal E-commerce application coupling HTML and VoiceXML E-commerce -User interface and interactions -Web applications , 2002, WWW 2002.

[11]  Jennifer Lai,et al.  Facilitating mobile communication with multimodal access to email messages on a cell phone , 2004, CHI EA '04.