Dual-Finger 3D Interaction Techniques for mobile devices

Three-dimensional capabilities on mobile devices are increasing, and the interactivity is becoming a key feature of these tools. It is expected that users will actively engage with the 3D content, instead of being passive consumers. Because touch-screens provide a direct means of interaction with 3D content by directly touching and manipulating 3D graphical elements, touch-based interaction is a natural and appealing style of input for 3D applications. However, developing 3D interaction techniques for handheld devices using touch-screens is not a straightforward task. One issue is that when interacting with 3D objects, users occlude the object with their fingers. Furthermore, because the user’s finger covers a large area of the screen, the smallest size of the object users can touch is limited. In this paper, we first inspect existing 3D interaction techniques based on their performance with handheld devices. Then, we present a set of precise Dual-Finger 3D Interaction Techniques for a small display. Finally, we present the results of an experimental study, where we evaluate the usability, performance, and error rate of the proposed and existing 3D interaction techniques.

[1]  Dieter Schmalstieg,et al.  Importance masks for revealing occluded objects in augmented reality , 2009, VRST '09.

[2]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[3]  Martin Hachet,et al.  Navidget for immersive virtual environments , 2008, VRST '08.

[4]  Wolfgang Hürst,et al.  Dynamic versus static peephole navigation of VR panoramas on handheld devices , 2010, MUM.

[5]  Andrew S. Forsberg,et al.  Aperture based selection for immersive virtual environments , 1996, UIST '96.

[6]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[7]  Martin Hachet,et al.  A study of direct versus planned 3D camera manipulation on touch-based mobile phones , 2009, Mobile HCI.

[8]  Shumin Zhai,et al.  Virtual reality for palmtop computers , 1993, TOIS.

[9]  Michael Gleicher,et al.  The challenges of 3D interaction , 1994, CHI Conference Companion.

[10]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[11]  Doug A. Bowman,et al.  Formalizing the Design, Evaluation, and Application of Interaction Techniques for Immersive Virtual Environments , 1999, J. Vis. Lang. Comput..

[12]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[13]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[14]  Andreas Butz,et al.  Interactions in the air: adding further depth to interactive tabletops , 2009, UIST '09.

[15]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[16]  Laurent Grisoni,et al.  3D positioning techniques for multi-touch displays , 2009, VRST '09.

[17]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[18]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[19]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[20]  Jef Raskin,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2000 .

[21]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[22]  Mark Billinghurst,et al.  Virtual object manipulation using a mobile phone , 2005, ICAT '05.

[23]  Chi-Wing Fu,et al.  Multi-touch techniques for exploring large-scale 3D astrophysical simulations , 2010, CHI.

[24]  Laurent Grisoni,et al.  Integrality and Separability of Multitouch Interaction Techniques in 3D Manipulation Tasks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[25]  James T. Miller,et al.  An Empirical Evaluation of the System Usability Scale , 2008, Int. J. Hum. Comput. Interact..

[26]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[27]  Ben Shneiderman,et al.  Why Not Make Interfaces Better than 3D Reality? , 2003, IEEE Computer Graphics and Applications.

[28]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[29]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[30]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.

[31]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[32]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[33]  Desney S. Tan,et al.  Exploring 3D navigation: combining speed-coupled flying with orbiting , 2001, CHI.

[34]  Doug A. Bowman,et al.  A methodology for the evaluation of travel techniques for immersive virtual environments , 1998, Virtual Reality.

[35]  Steven K. Feiner,et al.  Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[36]  Michael Gleicher,et al.  The challenges of 3D interaction: a CHI '94 workshop , 1994, SGCH.