An interaction model for universal interaction and control in multi display environments

In this paper we propose a framework for interaction within multi display environments. Each component of the framework is detailed, with comparisons to existing research in ubiquitous computing software infrastructures. We identify a key framework component: the interaction manager, which is designed to allow users to interact within multi display environments with multiple devices exhibiting multiple modalities. A scenario is presented that places this framework within the context of a 3D informational visualisation application.

[1]  Bruce H. Thomas,et al.  Interaction Modes for Augmented Reality Visualization , 2001, InVis.au.

[2]  Krzysztof Z. Gajos,et al.  A knowledge-based resource management system for the intelligent room , 2000 .

[3]  Armando Fox,et al.  The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms , 2002, IEEE Pervasive Comput..

[4]  Bruce H. Thomas,et al.  Tangible User Interaction Using Augmented Reality , 2002, AUIC.

[5]  Desney S. Tan,et al.  Developing a Generic Augmented-Reality Interface , 2002, Computer.

[6]  Harold Fox,et al.  Evaluating look-to-talk: a gaze-aware interface in a collaborative environment , 2002, CHI Extended Abstracts.

[7]  Kaj Grønbæk,et al.  Intelligent Buildings and pervasive computing: research perspectives and discussions , 2001 .

[8]  Ivan Poupyrev,et al.  Virtual object manipulation on a table-top AR environment , 2000, Proceedings IEEE and ACM International Symposium on Augmented Reality (ISAR 2000).

[9]  Brenton A. Phillips.  Metaglue: A Programming Language for Multi-Agent Systems by , 1999 .

[10]  A. Fox,et al.  Integrating information appliances into an interactive workspace , 2000, IEEE Computer Graphics and Applications.

[11]  Rudi Vernik,et al.  Rapid Assembly and Deployment of Domain Visualisation Solutions , 2001, InVis.au.

[12]  Trevor Darrell,et al.  Fast stereo-based head tracking for interactive environments , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[13]  Norbert A. Streitz,et al.  Roomware for Cooperative Buildings: Integrated Design of Architectural Spaces and Information Spaces , 1998, CoBuild.

[14]  Matthew Phillips,et al.  Integrated Visualisation and Description of Complex Systems , 1999 .

[15]  Krzysztof Z. Gajos,et al.  Rascal - A Resource Manager for Multi Agent Systems in Smart Spaces , 2001, CEEMAS.

[16]  Hirokazu Kato,et al.  Marker tracking and HMD calibration for a video-based augmented reality conferencing system , 1999, Proceedings 2nd IEEE and ACM International Workshop on Augmented Reality (IWAR'99).

[17]  Joseph Polifroni,et al.  Recognition confidence scoring and its use in speech understanding systems , 2002, Comput. Speech Lang..

[18]  Curtis Blais,et al.  WEB-BASED 3D TECHNOLOGY FOR SCENARIO AUTHORING AND VISUALIZATION: THE SAVAGE PROJECT , 2001 .

[19]  Pat Hanrahan,et al.  ICrafter: A Service Framework for Ubiquitous Computing Environments , 2001, UbiComp.

[20]  R.A. Brooks,et al.  The Intelligent Room project , 1997, Proceedings Second International Conference on Cognitive Technology Humanizing the Information Age.