Disocclusion Headlight for Selection Assistance in VR

We introduce the disocclusion headlight, a method for VR selection assistance based on alleviating occlusions at the center of the user's field of view. The user's visualization of the VE is modified to reduce overlap between objects. This way, selection candidate objects have larger image footprints, which facilitates selection. The modification is confined to the center of the frame, with continuity to the periphery of the frame which is rendered conventionally. The selection assistance is provided automatically, without any interaction from the user. Furthermore, our method disoccludes without destroying the local spatial relationships between selection candidates, which allows solving complex selection queries based on the relative position of objects. We have tested our method on three selection tasks, where we compared it to two state-of-the-art VR selection techniques, i.e., the alpha cursor and the flower cone. Our method showed significant advantages in terms of shorter task completion times, and of fewer selection errors.

[1]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[2]  Frédéric Mérienne,et al.  Comparing VR environments for seat selection in an opera theater , 2017, 2017 IEEE Symposium on 3D User Interfaces (3DUI).

[3]  Roel Vertegaal,et al.  Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops , 2011, ITS '11.

[4]  Xiaoxia Han,et al.  A Framework for Virtual Hand Haptic Interaction , 2010, Trans. Edutainment.

[5]  Doug A. Bowman,et al.  Rapid and accurate 3D selection by progressive refinement , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Torsten Kuhlen,et al.  GPU implementation of 3D object selection by conic volume techniques in virtual environments , 2010, 2010 IEEE Virtual Reality Conference (VR).

[7]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[8]  Ferran Argelaguet,et al.  Efficient 3D Pointing Selection in Cluttered Virtual Environments , 2009, IEEE Computer Graphics and Applications.

[9]  Karin Coninx,et al.  Exploring the Effects of Environment Density and Target Visibility on Object Selection in 3D Virtual Environments , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[10]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[11]  Voicu Popescu,et al.  Efficient VR and AR Navigation Through Multiperspective Occlusion Management , 2018, IEEE Transactions on Visualization and Computer Graphics.

[12]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[13]  Colin Ware Using hand position for virtual object placement , 2005, The Visual Computer.

[14]  Joseph J. LaViola,et al.  Dense and Dynamic 3D Selection for Game-Based Virtual Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[15]  Voicu Popescu,et al.  Multiperspective Focus+Context Visualization , 2016, IEEE Transactions on Visualization and Computer Graphics.

[16]  Ferran Argelaguet,et al.  A survey of 3D object selection techniques for virtual environments , 2013, Comput. Graph..

[17]  Tilman Dingler,et al.  Fully-Occluded Target Selection in Virtual Reality , 2020, IEEE Transactions on Visualization and Computer Graphics.

[18]  Robert J. Teather,et al.  Pointing at 3D targets in a stereo head-tracked virtual environment , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[19]  Markus Neuhäuser,et al.  Wilcoxon Signed Rank Test , 2006 .

[20]  Dominique Bechmann,et al.  Starfish: a selection technique for dense virtual environments , 2012, VRST '12.

[21]  Chun Yu,et al.  Investigating Bubble Mechanism for Ray-Casting to Improve 3D Target Acquisition in Virtual Reality , 2020, 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[22]  J. Edward Swan,et al.  Toward Disambiguating Multiple Selections for Frustum-Based Pointing , 2006, 3D User Interfaces (3DUI'06).

[23]  Ferran Argelaguet,et al.  Overcoming eye-hand visibility mismatch in 3D pointing selection , 2008, VRST '08.

[24]  Fabrice Matulic,et al.  Multiray: Multi-Finger Raycasting for Large Displays , 2018, CHI.

[25]  Robert J. Teather,et al.  EZCursorVR: 2D Selection with Virtual Reality Head-Mounted Displays , 2018, Graphics Interface.

[26]  Matthias Bues,et al.  iSith - Intersection-based Spatial Interaction for Two Hands , 2006, 3D User Interfaces (3DUI'06).

[27]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[28]  Niklas Elmqvist,et al.  A Taxonomy of 3D Occlusion Management for Visualization , 2008, IEEE Transactions on Visualization and Computer Graphics.

[29]  Frits H. Post,et al.  IntenSelect: using dynamic object rating for assisting 3D object selection , 2005, EGVE'05.

[30]  Ferran Argelaguet,et al.  Anisomorphic ray-casting manipulation for interacting with 2D GUIs , 2007, Comput. Graph..

[31]  Timo Ropinski,et al.  Object Selection in Virtual Environments using an Improved Virtual Pointer Metaphor , 2004, ICCVG.

[32]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[33]  Voicu Popescu,et al.  VR Exploration Assistance through Automatic Occlusion Removal , 2019, IEEE Transactions on Visualization and Computer Graphics.

[34]  Lili Wang,et al.  View Splicing for Effective VR Collaboration , 2020, 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[35]  Voicu Popescu,et al.  The graph camera , 2009, ACM Trans. Graph..

[36]  Tovi Grossman,et al.  The design and evaluation of selection techniques for 3D volumetric displays , 2006, UIST.

[37]  Steven K. Feiner,et al.  The Flexible Pointer: An Interaction Technique for Selection in Augmented and Virtual Reality , 2003 .

[38]  Géry Casiez,et al.  RayCursor: A 3D Pointing Facilitation Technique based on Raycasting , 2019, CHI.

[39]  Roel Vertegaal,et al.  MultiPoint: Comparing laser and manual pointing as remote input in large display interactions , 2012, Int. J. Hum. Comput. Stud..

[40]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[41]  Jacob Cohen Statistical Power Analysis for the Behavioral Sciences , 1969, The SAGE Encyclopedia of Research Design.

[42]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.