MiReAS: a mixed reality software framework for iterative prototyping of control strategies for an indoor airship

Virtual prototyping has become an established design tool in complex interdisciplinary development processes using state-of-the-art virtual reality techniques. Due to numerous benefits virtual prototyping has seen increasing acceptance in recent years, especially in the development of systems that involve complex interactions between components or require the integration of newly developed hardware. Mixed reality, considered as an extension to VR, has high potential to support the development of complex systems that operate in a real world environment even further. In this paper we demonstrate that the principles of mixed reality prototyping can also be effectively applied to the development of complex systems if a structured process is defined and supported by a proper software framework. In our paper we present a system that supports an iterative approach to prototype complex dynamical systems. Using this approach allows the designer to seamlessly progress from an initial virtual prototype to the final system along the mixed reality continuum. We describe MiReAS, a mixed reality software framework that supports an iterative design evolution with arbitrary combinations of real and virtual elements. The use of the system is demonstrated by the development of interaction techniques and control strategies for an unmanned aerial vehicle.

[1]  Wolfgang Broll,et al.  Interactive Bits: Prototyping of Mixed Reality Applications and Interaction Techniques through Visual Programming , 2008, 2008 IEEE Symposium on 3D User Interfaces.

[2]  Michael Haller,et al.  AMIRE - authoring mixed reality , 2002, The First IEEE International Workshop Agumented Reality Toolkit,.

[3]  P. Milgram,et al.  A Taxonomy of Mixed Reality Visual Displays , 1994 .

[4]  Daniela Gorski Trevisan,et al.  Model-based design, generation, and evaluation of virtual user interfaces , 2004, Web3D '04.

[5]  Carolina Cruz-Neira,et al.  VR Juggler - An Open Source platform for virtual reality applications , 2002 .

[6]  Dieter Schmalstieg,et al.  OpenTracker-an open software architecture for reconfigurable tracking based on XML , 2001, Proceedings IEEE Virtual Reality 2001.

[7]  Dieter Schmalstieg,et al.  The Studierstube Augmented Reality Project , 2002, Presence: Teleoperators & Virtual Environments.

[8]  Jay David Bolter,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, SIGGRAPH 2005.

[9]  Ken Schwaber,et al.  Agile Project Management with Scrum , 1980 .

[10]  Christian Geiger,et al.  Development of an augmented reality game by extendinga 3D authoring system , 2007, ACE '07.

[11]  Rudy Darken,et al.  The Delta3D Open Source Game Engine , 2005, IEEE Computer Graphics and Applications.

[12]  Karin Coninx,et al.  High-Level Modeling of Multimodal Interaction Techniques Using NiMMiT , 2007, J. Virtual Real. Broadcast..

[13]  Karin Coninx,et al.  A Model-Based Design Process for Interactive Virtual Environments , 2005, DSV-IS.

[14]  Blair MacIntyre,et al.  DART: a toolkit for rapid design exploration of augmented reality experiences , 2005, ACM Trans. Graph..

[15]  Raimund Dachselt,et al.  Workshop 2: Mixed Reality User Interfaces: Specification, Authoring, Adaptation , 2007, VR.