DrillSample: precise selection in dense handheld augmented reality environments

One of the primary tasks in a dense mobile augmented reality (AR) environment is to ensure precise selection of an object, even if it is occluded or highly similar to surrounding virtual scene objects. Existing interaction techniques for mobile AR usually use the multi-touch capabilities of the device for object selection. However, single touch input is imprecise, but existing two handed selection techniques to increase selection accuracy do not apply for one-handed handheld AR environments. To address the requirements of accurate selection in a one-handed dense handheld AR environment, we present the novel selection technique DrillSample. It requires only single touch input for selection and preserves the full original spatial context of the selected objects. This allows disambiguating and selection of strongly occluded objects or of objects with high similarity in visual appearance. In a comprehensive user study, we compare two existing selection techniques with DrillSample to explore performance, usability and accuracy. The results of the study indicate that DrillSampe achieves significant performance increases in terms of speed and accuracy. Since existing selection techniques are designed for virtual environments (VEs), we furthermore provide a first approach towards a foundation for exploring 3D selection techniques in dense handheld AR.

[1]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[2]  Joseph J. LaViola,et al.  Dense and Dynamic 3D Selection for Game-Based Virtual Environments , 2012, IEEE Transactions on Visualization and Computer Graphics.

[3]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[4]  Mark Green,et al.  JDCAD: A highly interactive 3D modeling system , 1994, Comput. Graph..

[5]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[6]  Jin Sung Choi,et al.  Freeze-Set-Go interaction method for handheld mobile augmented reality environments , 2009, VRST '09.

[7]  Doug A. Bowman,et al.  Rapid and accurate 3D selection by progressive refinement , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[8]  Hannes Kaufmann,et al.  ARTiFICe - Augmented Reality Framework for Distributed Collaboration , 2012, Int. J. Virtual Real..

[9]  Tolga K. Çapin,et al.  Dual-Finger 3D Interaction Techniques for mobile devices , 2012, Personal and Ubiquitous Computing.

[10]  Wolfgang Hürst,et al.  Gesture-based interaction via finger tracking for mobile augmented reality , 2011, Multimedia Tools and Applications.

[11]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[12]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[13]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[14]  Marvin Everett Mundel,et al.  Motion and Time Study: Improving Productivity , 1970 .

[15]  Wolfgang Hürst,et al.  Multimodal Interaction Concepts for Mobile Augmented Reality Applications , 2011, MMM.

[16]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..