Virtual Environments as Hybrid Systems

The development of virtual environments (VEs) is a non-trivial task. Many VEs are based around particular technologies and developed using ad hoc prototyping. This is undesirable if any formal evaluation of the system is to be attempted. It is also common for descriptions of VEs to be left at an informal level, if described at all. This is because VEs are dynamic environments and due to their continuous and highly visual nature, defining salient and useful aspects of them is extremely difficult. VEs are made up of a complex collection of discrete and continuous processes. Also, each individual element can be thought of as a mixed model in its own right. Thus, traditional discrete modelling techniques are not appropriate. What is proposed here is that techniques from hybrid systems research be used to mirror the hybrid nature of VEs. We demonstrate how techniques developed for modelling hybrid systems can be used to represent VE interaction. Two example interaction techniques from the VE literature are presented. Some insights gained into the nature of the VE interaction and the consideration of the hybrid model in terms of an architectural system design are discussed.

[1]  Jean-Marie Flaus,et al.  Hybrid Flow Nets for Hybrid Processes: Modelling and Control , 1997, HART.

[2]  Daniel C. Robbins,et al.  Three-dimensional widgets , 1992, I3D '92.

[3]  Philip J. Barnard,et al.  Interactions with Advanced Graphical Interfaces and the Deployment of Latent Human Knowledge , 1994, DSV-IS.

[4]  David Garlan Higher Order Connectors , 1998 .

[5]  J. Forrester Industrial Dynamics , 1997 .

[6]  David Garlan,et al.  Beyond definition/use: architectural interconnection , 1994 .

[7]  J. Forrester System Dynamics and the Lessons of 35 Years , 1993 .

[8]  Philippe A. Palanque,et al.  Design, specification, and verification of interactive systems , 2000, Proceedings of the 2000 International Conference on Software Engineering. ICSE 2000 the New Millennium.

[9]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[10]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[11]  Stephen P. Banks,et al.  Modelling of Hybrid Systems Based on Extended Coloured Petri Nets , 1994, Hybrid Systems.

[12]  He Jifeng,et al.  From CSP to hybrid systems , 1994 .

[13]  Sharon A. Stansfield,et al.  MediSim: a prototype VR system for training medical first responders , 1997, Proceedings. IEEE 1998 Virtual Reality Annual International Symposium (Cat. No.98CB36180).

[14]  Hallvard Trætteberg Modelling Direct Manipulation Using Referent and Statecharts , 1998, DSV-IS.

[15]  Daniel Thalmann,et al.  VB2: an architecture for interaction in synthetic worlds , 1993, UIST '93.

[16]  David Garlan,et al.  A formal basis for architectural connection , 1997, TSEM.

[17]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[18]  Randy F. Pausch,et al.  Navigation and locomotion in virtual worlds via flight into hand-held miniatures , 1995, SIGGRAPH.

[19]  P. Barnard,et al.  Interacting cognitive subsystems: A systemic approach to cognitive-affective interaction and change , 1991 .

[20]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[21]  C. Petri Kommunikation mit Automaten , 1962 .

[22]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[23]  Tadao Murata,et al.  Petri nets: Properties, analysis and applications , 1989, Proc. IEEE.

[24]  Kaisa Väänänen,et al.  Gesture Driven Interaction as a Human Factor in Virtual Environments - An Approach with Neural Networks , 1993, Virtual Reality Systems.

[25]  David A. Duce,et al.  Syndetic Modelling , 1998, Hum. Comput. Interact..

[26]  James C. Chung,et al.  Intuitive navigation in the targeting of radiation therapy treatment beams , 1993 .

[27]  Ralf Wieting Hybrid high-level nets , 1996, Winter Simulation Conference.