A Framework to Develop VR Interaction Techniques Based on OpenInterface and AFreeCA

Implementing appropriate interaction for Virtual Reality (VR) applications is one of the most challenging tasks that a developer has to face. This challenge is due to both technical and theoretical factors. First, from a technical point of view, the developer does not only have to deal with nonstandard devices, he has to facilitate their use in a parallel a coordinated way, interweaving the fields of 3D and multimodal interaction. Secondly, from a theoretical point of view, he has to design the interaction almost from scratch, as a standard set of interaction techniques and interactive tasks has not been identified. All these factors are reflected in the absence of appropriate tools to implement VR interaction techniques. In this paper, some existing tools that aim at the development of VR interaction techniques are studied, analysing their strengths and, more specifically, their shortcomings, such as the difficulties to integrate them with any VR platform or their absence of a strong conceptual background. Following that, a framework to implement VR interaction techniques is described that provides the required support for multimodal interaction and, also, uses experience gained from the study of the former tools to avoid previous mistakes. Finally, the usage of the resulting framework is illustrated with the development of the interaction techniques of a sample application.

[1]  Augusto Celentano,et al.  Interaction locus: a Multimodal Approach for the Structuring of Virtual Spaces , 2001 .

[2]  Chris Greenhalgh,et al.  Inside MASSIVE-3: flexible support for data consistency and world structuring , 2000, CVE '00.

[3]  Ann Blandford,et al.  Four easy pieces for assessing the usability of multimodal interaction: the CARE properties , 1995, INTERACT.

[4]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[5]  Molina Masso,et al.  Un enfoque estructurado para el desarrollo de interfaces de ususario 3D , 2012 .

[6]  Deborah Hix,et al.  User-Centered Design and Evaluation of Virtual Environments , 1999, IEEE Computer Graphics and Applications.

[7]  H. James Hoover,et al.  InTml: a description language for VR applications , 2002, Web3D '02.

[8]  Michael Gleicher,et al.  The challenges of 3D interaction: a CHI '94 workshop , 1994, SGCH.

[9]  José Pascual Molina,et al.  A Model of Interaction for CVEs Based on the Model of Human Communication , 2008, J. Univers. Comput. Sci..

[10]  Carolina Cruz-Neira,et al.  VR Juggler: a virtual platform for virtual reality application development , 2001, Proceedings IEEE Virtual Reality 2001.

[11]  Karin Coninx,et al.  High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT , 2007, J. Virtual Real. Broadcast..

[12]  Lakshmi Sastry,et al.  Development of the INQUISITIVE 1 Interaction Toolkit-Concept and Realisation , 1999 .

[13]  V. Leitáo,et al.  Computer Graphics: Principles and Practice , 1995 .

[14]  Doug A. Bowman,et al.  Towards a system for reusable 3D interaction techniques , 2007, VRST '07.

[15]  Chris Shaw,et al.  Decoupled simulation in virtual reality with the MR toolkit , 1993, TOIS.

[16]  Michael Gleicher,et al.  The challenges of 3D interaction , 1994, CHI Conference Companion.

[17]  P. Gonzalez,et al.  An interaction model for the TRES-D framework , 2006, MELECON 2006 - 2006 IEEE Mediterranean Electrotechnical Conference.

[18]  Jon Barrilleaux 3D User Interfaces with Java 3D , 2000 .

[19]  Henrik Tramberend,et al.  Avocado: a distributed virtual reality framework , 1999, Proceedings IEEE Virtual Reality (Cat. No. 99CB36316).

[20]  Alistair G. Sutcliffe Multimedia and virtual reality - designing multisensory user interfaces , 2003 .

[21]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[22]  Benoit M. Macq,et al.  Usability evaluation of virtual reality interaction techniques for positioning and manoeuvring in reduced, manipulation-oriented environments , 2010, The Visual Computer.

[23]  Doug A. Bowman,et al.  CHASM : Bridging Description and Implementation of 3 D Interfaces , 2005 .

[24]  Emmanuel Frécon,et al.  DIVE: a scaleable network architecture for distributed virtual environments , 1998, Distributed Syst. Eng..

[25]  M. Carter Computer graphics: Principles and practice , 1997 .

[26]  Dieter Schmalstieg,et al.  OpenTracker-an open software architecture for reconfigurable tracking based on XML , 2001, Proceedings IEEE Virtual Reality 2001.

[27]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[28]  James C. Miller,et al.  Computer graphics principles and practice, second edition , 1992, Comput. Graph..

[29]  José Pascual Molina,et al.  AFreeCA: Extending the Spatial Model of Interaction , 2010, 2010 International Conference on Cyberworlds.

[30]  Jean Vanderdonckt,et al.  An open source workbench for prototyping multimodal interactions based on off-the-shelf heterogeneous components , 2009, EICS '09.

[31]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[32]  Frits H. Post,et al.  StateStream: a developer-centric approach towards unifying interaction models and architecture , 2009, EICS '09.

[33]  Ivan Poupyrev,et al.  An Introduction to 3-D User Interface Design , 2001, Presence: Teleoperators & Virtual Environments.