vDesign: a CAVE-based virtual design environment using hand interactions

The cave automatic virtual environment (CAVE) system is one of the most fully immersive systems for virtual reality environments. By providing users with realistic perception and immersive experience, CAVE systems have been widely used in many fields, including military, education, health care, entertainment, design, and others. In this paper, we focus on the design applications in the CAVE. The design applications involve many interactions between the user and the CAVE. However, the conventional interaction tool, the wand, cannot provide fast and convenient interactions. In this paper, we propose vDesign, a CAVE-based virtual design environment using hand interactions. The hand interactions in vDesign are classified into menu navigation and object manipulations. For menu navigation, we define two interactions: activating the main menu and selecting a menu item. For object manipulations, we define three interactions: moving, rotating, and scaling an object. By using the proposed hand interactions, we develop the functions of image segmentation and image composition in vDesign. With the image segmentation function, the designer can select and cut the interested objects from different images. With the image composition function, the designer can manipulate the segmented objects and combine them as a composite image. We implemented the vDesign prototype in CAVE and conducted experiments to evaluate the interaction performance in terms of manipulation time and distortion. The experimental results demonstrated that the proposed hand interactions can provide faster and more accurate interactions compared to the traditional wand interactions.

[1]  Jennifer Lawrence,et al.  Communication in the Age of Virtual Reality. , 1997 .

[2]  Austin J. Brockmeier,et al.  Evaluating dependence in spike train metric spaces , 2011, The 2011 International Joint Conference on Neural Networks.

[3]  Chris Dede,et al.  Introduction to Virtual Reality in Education , 2010 .

[4]  Mitsunori Makino,et al.  CRAYON A 3D Solid Modeling System on the CAVE , 2009, 2009 Fifth International Conference on Image and Graphics.

[5]  H. Creagh.  Cave Automatic Virtual Environment , 2003, Proceedings: Electrical Insulation Conference and Electrical Manufacturing and Coil Winding Technology Conference (Cat. No.03CH37480).

[6]  Akira Kageyama,et al.  Introduction to Virtual Reality Visualization by the CAVE system , 2005 .

[7]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[8]  M. Press.  Presence : teleoperators and virtual environments. , 2014 .

[9]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[10]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[11]  Francis K. H. Quek,et al.  The Effects of Finger-Walking in Place (FWIP) for Spatial Knowledge Acquisition in Virtual Environments , 2010, Smart Graphics.

[12]  Marc Cavazza,et al.  CaveUDK: a VR game engine middleware , 2012, VRST '12.

[13]  Terrence Fernando,et al.  Investigating interaction in CAVE virtual environments , 2006, TCHI.

[14]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[15]  Milos Manic,et al.  CAVE-SOM: Immersive visual data mining using 3D Self-Organizing Maps , 2011, The 2011 International Joint Conference on Neural Networks.

[16]  Ali Mazalek,et al.  Tangible navigation and object manipulation in virtual environments , 2011, Tangible and Embedded Interaction.

[17]  Thomas A. DeFanti,et al.  Size-Constancy in the CAVE , 2007, PRESENCE: Teleoperators and Virtual Environments.

[18]  Song Wang,et al.  New benchmark for image segmentation evaluation , 2007, J. Electronic Imaging.

[19]  J. Norris,et al.  Stage: Controlling space robots from a CAVE on Earth , 2012, 2012 IEEE Aerospace Conference.

[20]  Doug A. Bowman,et al.  Design and evaluation of menu systems for immersive virtual environments , 2001, Proceedings IEEE Virtual Reality 2001.

[21]  Frank Biocca,et al.  Immersive virtual reality technology , 1995 .

[22]  Lik-Kwan Shark,et al.  Real-Time Immersive Table Tennis Game for Two Players with Motion Tracking , 2010, 2010 14th International Conference Information Visualisation.

[23]  Peng Song,et al.  WYSIWYF: exploring and annotating volume data with a tangible handheld device , 2011, CHI.

[24]  Christoph W. Borst,et al.  Handymap: A Selection Interface for Cluttered VR Environments Using a Tracked Hand-Held Touch Device , 2011, ISVC.

[25]  Philippe Coiffet,et al.  Virtual Reality Technology , 2003, Presence: Teleoperators & Virtual Environments.

[26]  Vladimir Kolmogorov,et al.  "GrabCut": interactive foreground extraction using iterated graph cuts , 2004, ACM Trans. Graph..

[27]  Carolina Cruz-Neira,et al.  Surround-Screen Projection-Based Virtual Reality: The Design and Implementation of the CAVE , 2023 .

[28]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[29]  John C. Hart,et al.  The CAVE: audio visual experience automatic virtual environment , 1992, CACM.

[30]  Justin C. D. Savage,et al.  Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments , 2002 .

[31]  Xiang Yang,et al.  A human-centered Virtual Factory , 2011, MSIE 2011.

[32]  Shital A. Raut,et al.  Image Segmentation – A State-Of-Art Survey for Prediction , 2009, 2009 International Conference on Advanced Computer Control.

[33]  Qiong Wu,et al.  A real-time performance system for virtual theater , 2010, SMVC '10.