Beyond traditional interaction in a mobile environment: New approach to 3D scene rendering

Abstract In this paper the problems of user interaction in a mobile environment are investigated. Interaction in this environment imposes new requirements both on UI designers and the users. This paper deals in particular with problems of graphical interaction in a mobile environment. The interaction in a mobile environment requires new approaches that will result in a new type of rendering of graphical data. A rendering technique that enables rendering and annotation of objects in a 3D scene on mobile devices is presented. This technique is based on transformation of the 3D scene to a 2D vector graphic representation. The input 3D scene is given in the VRML format and the output 2D format is SVG. In the second part of this paper we are presenting a prototype of a voice user interface that allows users to interact with the graphical data in a mobile environment. The semantic description of the scene plays the key role in restriction of the language used for communication. The communication between the user and the mobile system is performed by means of natural language that is restricted according to the context the user is currently in. The implementation of the voice user interface is based on the existing VoiceXML platform.

[1]  Claudio Zunino,et al.  A distributed architecture for searching, retrieving and visualizing complex 3D models on Personal Digital Assistants , 2004, Int. J. Hum. Comput. Stud..

[2]  Teija Vainio,et al.  Developing 3D information systems for mobile users: some usability issues , 2002, NordiCHI '02.

[3]  Thomas Ertl,et al.  Remote line rendering for mobile devices , 2004 .

[4]  Antoine Quint,et al.  Scalable Vector Graphics , 2020, Definitions.

[5]  Zdenek Míkovec,et al.  Object based manipulation with 3D scenes in mobile environment , 2005, Mobile Computing and Ambient Intelligence.

[6]  Norbert Reithinger,et al.  SmartKom: adaptive and flexible multimodal access to multiple applications , 2003, ICMI '03.

[7]  Zdenek Míkovec,et al.  Ontology driven voice-based interaction in mobile environment , 2005, Mobile Computing and Ambient Intelligence.

[8]  Victor Zue,et al.  JUPlTER: a telephone-based conversational interface for weather information , 2000, IEEE Trans. Speech Audio Process..

[9]  Martin E. Newell,et al.  A solution to the hidden surface problem , 1972, ACM Annual Conference.

[10]  Andrea Sanna,et al.  A 3D Multiresolution rendering engine for PDA devices , 2003 .

[11]  Sharon L. Oviatt,et al.  Advances in Robust Multimodal Interface Design , 2003, IEEE Computer Graphics and Applications.

[12]  Norbert Pfleger,et al.  Context based multimodal fusion , 2004, ICMI '04.

[13]  Ken Sakamura,et al.  CASIS: a context-aware speech interface system , 2005, IUI.