The design space of dynamic interactive virtual environments

Virtual environments have become a key component of many fields and the critical component of virtual reality applications. Due to their virtual nature, they can accommodate an infinite number of possibilities. A theoretical work is presented, which decomposes those innumerous possibilities into concepts to help clarify the vast design space and provide insights into future applied research. We propose that what makes environments interesting and engaging is having worlds that are both active and reactive. This article explores the manifestations of those actions and reactions in what we term: dynamic components and interactions. We term worlds containing these dynamic interactive virtual environments (DIVE). An analysis of each component time was performed, with the purpose of providing a theoretical understanding of the respective design spaces. Initially, we collected the myriad possibilities of each component, e.g., the possible kinds of interactions. We point to examples throughout the field to ground and explain concepts presented. We then categorized of each area into taxonomies. The result of the analyses provides insights into the design space of virtual environments, exposes several avenues of research that are yet underexplored, and provides better understandings of ways in which DIVE creation can be supported.

[1]  Steffi Beckhaus,et al.  Dynamic potential fields for guided exploration in virtual environments , 2002 .

[2]  W. Scherer,et al.  Using agent-based simulation to reduce collateral damage during military operations , 2004, Proceedings of the 2004 IEEE Systems and Information Engineering Design Symposium, 2004..

[3]  Brenda K. Wiederhold,et al.  A Randomized, Controlled Trial of Virtual Reality-Graded Exposure Therapy for Post-Traumatic Stress Disorder in Active Duty Service Members with Combat-Related Post-Traumatic Stress Disorder , 2011, Cyberpsychology Behav. Soc. Netw..

[4]  Marc Herrlich,et al.  Proxy-Based Selection for Occluded and Dynamic Objects , 2011, Smart Graphics.

[5]  Judy M. Vance,et al.  Integrating operations simulation results with an immersive virtual reality environment , 2004, Proceedings of the 2004 Winter Simulation Conference, 2004..

[6]  Sandeep Singhal,et al.  Networked virtual environments , 1999 .

[7]  Brenda K. Wiederhold,et al.  Lessons Learned from 350 Virtual-Reality Sessions with Warriors Diagnosed with Combat-Related Posttraumatic Stress Disorder , 2010, Cyberpsychology Behav. Soc. Netw..

[8]  Paul Hudak,et al.  Functional reactive programming from first principles , 2000, PLDI '00.

[9]  M. Schijven,et al.  The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review , 2009, Surgical Endoscopy.

[10]  Paul Hudak,et al.  Functional reactive animation , 1997, ICFP '97.

[11]  Steffi Beckhaus,et al.  Adaptive Generation of Emotional Impact Using Enhanced Virtual Environments , 2012, PRESENCE: Teleoperators and Virtual Environments.

[12]  Charles R. Figley,et al.  Combat Stress Injury : Theory, Research, and Management , 2011 .

[13]  Mel Slater,et al.  Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments , 2009, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  Andrew E. Johnson,et al.  NICE: combining constructionism, narrative and collaboration in a virtual learning environment , 1997, COMG.

[15]  Marc Cavazza,et al.  Alternative reality: a new platform for virtual reality art , 2003, VRST '03.

[16]  Carolina Cruz-Neira,et al.  Run-time reconfiguration in VR Juggler , 2000 .

[17]  Kristopher J. Blom,et al.  Functional Reactive Virtual Reality , 2007, EGVE.

[18]  Larry F. Hodges,et al.  A Virtual Environment for the Treatment of Chronic Combat-Related Post-Traumatic Stress Disorder , 1999, Cyberpsychology Behav. Soc. Netw..

[19]  Kristopher J. Blom,et al.  ChairIO--the Chair-Based Interface , 2007 .

[20]  Mark Jensen,et al.  The Effectiveness of Virtual Reality for Dental Pain Control: A Case Study , 2001, Cyberpsychology Behav. Soc. Netw..

[21]  Cheng Xian-yi,et al.  Review of Modern Speech Synthesis , 2011 .

[22]  Joseph J. LaViola,et al.  Immersive VR for Scientific Visualization: A Progress Report , 2000, IEEE Computer Graphics and Applications.

[23]  M. Jensen,et al.  Applications of virtual reality for pain management in burn-injured patients , 2008, Expert review of neurotherapeutics.

[24]  Henrik Nilsson,et al.  The Yampa arcade , 2003, Haskell '03.

[25]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[26]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[27]  Andrew Stern,et al.  Façade: An Experiment in Building a Fully-Realized Interactive Drama , 2003 .

[28]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[29]  Allison M. Okamura,et al.  Modeling of Tool-Tissue Interactions for Computer-Based Surgical Simulation: A Literature Review , 2008, PRESENCE: Teleoperators and Virtual Environments.

[30]  David B. Kaber,et al.  Telepresence , 1998, Hum. Factors.

[31]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[32]  Maria V. Sanchez-Vives,et al.  From presence to consciousness through virtual reality , 2005, Nature Reviews Neuroscience.

[33]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[34]  Kristopher J. Blom,et al.  Supporting the creation of dynamic, interactive virtual environments , 2007, VRST '07.

[35]  Mel Slater,et al.  Brain Computer Interface for Virtual Reality Control , 2009, ESANN.

[36]  Bernd Fröhlich,et al.  Virtual vs. Real-World Pointing in Two-User Scenarios , 2009, 2009 IEEE Virtual Reality Conference.

[37]  Daniel Thalmann,et al.  Direct 3D interaction with smart objects , 1999, VRST '99.

[38]  Georgios N. Yannakakis,et al.  Real-Time Game Adaptation for Optimizing Player Satisfaction , 2009, IEEE Transactions on Computational Intelligence and AI in Games.

[39]  Jiqiang Zhai,et al.  Design and Implementation , 2011 .

[40]  Brenda K. Wiederhold,et al.  Exposure Therapy with and without Virtual Reality to Treat PTSD while in the Combat Theater: A Parallel Case Series , 2009, Cyberpsychology Behav. Soc. Netw..

[41]  Steve Bryson.  Time, data-time, and real-time interactive visualization , 1997 .

[42]  Michael Zyda,et al.  Networked virtual environments - desgin and implementation , 1999 .

[43]  Hélène Fournier,et al.  Applying advanced user models and input technologies to augment military simulation-based training , 2010, SpringSim.

[44]  Indira Thouvenin,et al.  The ICEA plug-in for virtual reality, immersive creation and edition of animation , 2012, 2012 5th Workshop on Software Engineering and Architectures for Realtime Interactive Systems (SEARIS).

[45]  Frits H. Post,et al.  IntenSelect: using dynamic object rating for assisting 3D object selection , 2005, EGVE'05.

[46]  Carme Torras,et al.  3D collision detection: a survey , 2001, Comput. Graph..

[47]  Kristopher J. Blom,et al.  Dynamic, interactive virtual environments , 2009 .

[48]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[49]  Maria V. Sanchez-Vives,et al.  How we experience immersive virtual environments: the concept of presence and its measurement * , 2009 .

[50]  Giuseppe Riva,et al.  Emotional Response to Virtual Reality Exposure across Different Cultures: The Role of the Attribution Process , 2009, Cyberpsychology Behav. Soc. Netw..

[51]  Stephan Wong,et al.  Vision­Based Hand Gesture Recognition for Human Computer Interaction: A Review , 2008 .

[52]  Hirokazu Kato,et al.  Collaborative augmented reality , 2002, CACM.

[53]  Steffi Beckhaus,et al.  Effect based scene manipulation for multimodal VR systems , 2010, 2010 IEEE Virtual Reality Conference (VR).

[54]  Roland Schröder-Kroll Kristopher.  Interaction Techniques for Dynamic Virtual Environments , 2008 .

[55]  Benjamin Mesing,et al.  Using aspect oriented methods to add behaviour to X3D documents , 2006, Web3D '06.

[56]  V. Martin,et al.  SVis: A Computational Steering Visualization Environment for Surface Structure Determination , 2009, 2009 Second International Conference in Visualisation.

[57]  Gary W. Meyer,et al.  Automotive Spray Paint Simulation , 2008, ISVC.

[58]  H. Hoffman,et al.  Virtual reality exposure therapy for the treatment of posttraumatic stress disorder following September 11, 2001. , 2007, The Journal of clinical psychiatry.

[59]  Stephan Diehl,et al.  Proceedings of the sixth international conference on 3D Web technology , 2001 .

[60]  Jari Takatalo,et al.  Components of human experience in virtual environments , 2008, Comput. Hum. Behav..

[61]  Anthony Steed,et al.  Towards a General Model for Selection in Virtual Environments , 2006, 3D User Interfaces (3DUI'06).

[62]  Kristopher J. Blom,et al.  Emotional Storytelling , 2005 .

[63]  Pavel Zahorik,et al.  Presence as Being-in-the-World , 1998, Presence.

[64]  Henry C. Lin,et al.  Review of methods for objective surgical skill evaluation , 2011, Surgical Endoscopy.

[65]  Jin Sung Choi,et al.  Virtual Reality Based Welding Training Simulator with 3D Multimodal Interaction , 2010, 2010 International Conference on Cyberworlds.

[66]  Paul Richard,et al.  Modeling Dynamic Interaction in Virtual Environments and the Evaluation of Dynamic Virtual Fixtures , 2012, PRESENCE: Teleoperators and Virtual Environments.

[67]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[68]  Alexander Kulik.  Building on Realism and Magic for Designing 3D Interaction Techniques , 2009, IEEE Computer Graphics and Applications.

[69]  Raimund Dachselt,et al.  Behavior3D: an XML-based framework for 3D graphics behavior , 2003, Web3D '03.

[70]  Frédéric Boussinot,et al.  A reactive behavior framework for dynamic virtual worlds , 2001, Web3D '01.

[71]  G. Dunn,et al.  Virtual reality study of paranoid thinking in the general population , 2008, British Journal of Psychiatry.