How Can I Grab That?

Abstract The selection and manipulation of objects in Virtual Reality face application developers with a substantial challenge as they need to ensure a seamless interaction in three-dimensional space. Assessing the advantages and disadvantages of selection and manipulation techniques in specific scenarios and regarding usability and user experience is a mandatory task to find suitable forms of interaction. In this article, we take a look at the most common issues arising in the interaction with objects in VR. We present a taxonomy allowing the classification of techniques regarding multiple dimensions. The issues are then associated with these dimensions. Furthermore, we analyze the results of a study comparing multiple selection techniques and present a tool allowing developers of VR applications to search for appropriate selection and manipulation techniques and to get scenario dependent suggestions based on the data of the executed study.

[1]  Ivan Poupyrev,et al.  Manipulating Objects in Virtual Worlds: Categorization and Empirical Evaluation of Interaction Techniques , 1999, J. Vis. Lang. Comput..

[2]  G. Drew Kessler,et al.  PRISM interaction for enhancing control in immersive virtual environments , 2007, TCHI.

[3]  Frol Periverzov,et al.  IDS: The intent driven selection method for natural user interfaces , 2015, 2015 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  J. Michael Moshell,et al.  A Two-Handed Interface for Object Manipulation in Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[5]  Ferran Argelaguet,et al.  Efficient 3D Pointing Selection in Cluttered Virtual Environments , 2009, IEEE Computer Graphics and Applications.

[6]  Andrea Giachetti,et al.  A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments , 2018, Comput. Graph. Forum.

[7]  Pedro M. Domingos.  A few useful things to know about machine learning , 2012, Commun. ACM.

[8]  Daniel Mendes,et al.  Design and evaluation of a novel out-of-reach selection technique for VR using iterative refinement , 2017, Comput. Graph..

[9]  O'NeillEamonn,et al.  Special Section on Touching the 3rd Dimension , 2013 .

[10]  Harald Reiterer,et al.  Adaptive Pointing - Design and Evaluation of a Precision Enhancing Technique for Absolute Pointing Devices , 2009, INTERACT.

[11]  Ryan P. McMahan,et al.  VOTE: A ray-casting study of vote-oriented technique enhancements , 2018, Int. J. Hum. Comput. Stud..

[12]  Ivan Poupyrev,et al.  An Introduction to 3-D User Interface Design , 2001, Presence: Teleoperators & Virtual Environments.

[13]  Shumin Zhai,et al.  Scale effects in steering law tasks , 2001, CHI.

[14]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[15]  Doug A. Bowman,et al.  Novel Uses of Pinch Gloves™ for Virtual Environment Interaction Techniques , 2002, Virtual Reality.

[16]  Ferran Argelaguet,et al.  A survey of 3D object selection techniques for virtual environments , 2013, Comput. Graph..

[17]  John J. Leggett,et al.  Interaction styles and input/output devices , 1993, Behav. Inf. Technol..

[18]  Alfredo Pina,et al.  Design Choices and Their Implications for 3D Mid-Air Manipulation Techniques , 2014, PRESENCE: Teleoperators and Virtual Environments.

[19]  Eric D. Ragan,et al.  Questioning naturalism in 3D user interfaces , 2012, CACM.

[20]  Doug A. Bowman,et al.  New Directions in 3D User Interfaces , 2006 .

[21]  Joseph J. LaViola,et al.  Dense and Dynamic 3D Selection for Game-Based Virtual Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[22]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[23]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..