A SYSTEMATIC COLLECTION OF NATURAL INTERACTIONS FOR IMMERSIVE MODELING FROM BUILDING BLOCKS

Abstract The increased availability of affordable virtual reality hardware in the last years boosted research and development of such systems for many fields of application. While extended reality systems are well established for visualization of product data, immersive authoring tools that can create and modify that data are yet to see widespread productive use. Making use of building blocks, we see the possibility that such tools allow quick expression of spatial concepts, even for non-expert users. Optical hand-tracking technology allows the implementation of this immersive modeling using natural user interfaces. Here the users manipulated the virtual objects with their bare hands. In this work, we present a systematic collection of natural interactions suited for immersive building-block-based modeling systems. The interactions are conceptually described and categorized by the task they fulfil.

[1]  Christoph W. Borst,et al.  Realistic virtual grasping , 2005, IEEE Proceedings. VR 2005. Virtual Reality, 2005..

[2]  Franca Giannini,et al.  A Survey of Immersive Systems for Shape Manipulation , 2019 .

[3]  Caterina Rizzi,et al.  Virtual Reality Applications: Guidelines to Design Natural User Interface , 2018 .

[4]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[5]  Franca Giannini,et al.  A Study on Natural 3D Shape Manipulation in VR , 2018, STAG.

[6]  Ferran Argelaguet,et al.  A survey of 3D object selection techniques for virtual environments , 2013, Comput. Graph..

[7]  Daniel Mendes,et al.  Mid-air modeling with Boolean operations in VR , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[8]  Raimund Dachselt,et al.  Three-dimensional menus: A survey and taxonomy , 2007, Comput. Graph..

[9]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[10]  Andrea Giachetti,et al.  The smart pin: a novel object manipulation technique for immersive virtual environments , 2017, VRST.

[11]  Sandro Wartzack,et al.  Linking a game-engine with CAD-software to create a flexible platform for researching extended reality interfaces for the industrial design process , 2020 .

[12]  Alex H. B. Duffy,et al.  NATURAL AND INTUITIVE GESTURE INTERACTION FOR 3D OBJECT MANIPULATION IN CONCEPTUAL DESIGN , 2018 .

[13]  Daniel Thalmann,et al.  Multi-finger manipulation of virtual objects , 1996, VRST.

[14]  John L. Salmon,et al.  Capabilities of Current Generation Virtual Reality to Enhance the Design Process , 2017 .

[15]  Jinsheng Kang,et al.  Instant 3D design concept generation and visualization by real-time hand gesture recognition , 2013, Comput. Ind..

[16]  Peng Song,et al.  A handle bar metaphor for virtual object manipulation with mid-air interaction , 2012, CHI.

[17]  Sandro Wartzack,et al.  Natural Finger Interaction for CAD Assembly Modeling , 2017 .